-- Logs begin at Thu 2021-11-11 13:30:21 UTC, end at Thu 2021-11-11 14:44:42 UTC. -- Nov 11 14:14:48.439639 dv-cinder-777031-9-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 11 14:14:51.183067 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.common.config [-] Logging enabled! Nov 11 14:14:51.183606 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 11 14:14:51.183869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102156) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 11 14:14:51.187114 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.common.config [-] Logging enabled! Nov 11 14:14:51.187393 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 11 14:14:51.187699 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102156) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 11 14:14:51.188640 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 14:14:51.188872 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 14:14:51.189229 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 14:14:51.189474 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 14:14:51.189698 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 14:14:51.190016 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.190435 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 11 14:14:51.190746 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.191037 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.191327 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.191654 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.191942 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.192223 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.192513 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.193327 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.193614 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.193891 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.194169 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.194459 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.194741 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.195027 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.195313 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.195620 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] debug = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.195906 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.196334 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.196742 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.197023 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.197311 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.197589 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.197859 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.198132 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.198414 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.198739 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] host = dv-cinder-777031-9-iscsi {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.199014 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.199298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.199610 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.199894 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.200166 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.200439 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.200722 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.200992 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.201262 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.201534 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.201820 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.202102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.202388 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.202611 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.202830 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.203126 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.203439 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.203716 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.203989 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.204261 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.204533 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.204805 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.205072 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.205355 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.205633 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.205919 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.206190 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.206459 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.206727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.206996 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.207275 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.207579 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.207849 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.208119 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.208943 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.209213 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.209484 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.209781 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.210062 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.210344 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.210625 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.210895 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.211177 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.211474 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.211744 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.212011 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_json = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.212279 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.212544 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.212821 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.213089 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.213355 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.213623 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.213891 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.214171 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:51.214460 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.214752 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.215049 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.215328 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.215652 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.215934 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.216219 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.216492 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.216775 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.217059 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.217341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.217615 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.217899 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.218174 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.218469 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.218770 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.219063 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.219351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.219646 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.219920 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.220192 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.220467 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.220749 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.221025 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.221310 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.221595 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.221870 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.222154 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.222445 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.222732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.223005 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.223280 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.223590 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.223884 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.224160 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.224434 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.224719 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.224994 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.225267 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.225547 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.225827 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.226097 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.226367 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.226640 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.226926 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.227202 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.227498 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.227768 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.228041 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.228309 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.228590 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.228862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.229134 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.229403 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.229677 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.229944 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.230214 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.230485 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.230753 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.231027 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.231297 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.231589 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.231860 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.232130 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.232397 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.232665 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.232932 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.233206 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.233472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.233739 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.234007 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.234275 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.234545 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.234827 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.235121 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.235419 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.235697 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.235977 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.236251 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.236523 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.236794 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.237068 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.237341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.237610 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.237896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.238174 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.238455 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.238734 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.239010 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.239327 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.239649 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.239929 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.240203 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.240476 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.240755 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.241035 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.241326 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.241616 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.241907 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.242195 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.242482 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.242757 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.243062 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.243337 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:51.243573 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 14:14:51.243809 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102156) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 11 14:14:51.671647 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 14:14:51.671925 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 14:14:51.672225 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 14:14:51.672570 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 11 14:14:51.998673 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:51.998970 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:51.999241 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.000448 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.000725 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.000990 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.034716 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.034995 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.035265 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.050817 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.051099 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.051395 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.080927 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.081208 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.081479 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.117867 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.118147 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.118415 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.352850 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.353454 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.353454 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.353594 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.354250 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.480294 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.480621 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.480905 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.481179 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.481455 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.481769 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.482026 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.482280 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.482535 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.482818 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.483076 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.483343 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.483625 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.483876 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.484129 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.484391 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.484645 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.484910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.485176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.485436 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.485707 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.485958 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.486234 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.486611 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.486860 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.487106 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.487534 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.487773 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.488007 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.488241 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.488474 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.488706 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:52.489066 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 11 14:14:52.492331 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 11 14:14:52.496293 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 11 14:14:52.500113 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(300, 349)])]) Nov 11 14:14:52.501750 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 11 14:14:52.502204 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 11 14:14:52.502534 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 11 14:14:52.502916 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 11 14:14:52.505766 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 11 14:14:52.506018 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 11 14:14:52.506363 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 14:14:52.511660 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 11 14:14:52.534314 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 11 14:14:52.534767 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.535061 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102156) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 11 14:14:52.535453 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.537383 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102156) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 11 14:14:52.537662 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 11 14:14:52.537906 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 11 14:14:52.541129 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.541410 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:52.605534 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 11 14:14:52.605718 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 11 14:14:52.605951 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 11 14:14:52.606317 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 11 14:14:52.626297 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_db.sqlalchemy.engines [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 14:14:53.306326 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing driver for type 'gre' Nov 11 14:14:53.306850 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] gre ID ranges: [(1, 1000)] Nov 11 14:14:53.488038 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing driver for type 'local' Nov 11 14:14:53.488621 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing driver for type 'vlan' Nov 11 14:14:53.556937 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] VlanTypeDriver initialization complete Nov 11 14:14:53.557280 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing driver for type 'vxlan' Nov 11 14:14:53.557820 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] vxlan ID ranges: [(1, 1000)] Nov 11 14:14:53.751256 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing extension driver 'port_security' Nov 11 14:14:53.751587 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.extensions.port_security [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] PortSecurityExtensionDriver initialization complete Nov 11 14:14:53.751919 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing mechanism driver 'openvswitch' Nov 11 14:14:53.752241 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing mechanism driver 'hyperv' Nov 11 14:14:53.758795 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.plugin [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102156) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:14:53.759666 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.760042 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.760391 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.760921 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.761353 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.761704 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.762046 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.762446 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.762843 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.763185 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.763556 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.766993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.766993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.766993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.766993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.766993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.767351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.767351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.767351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.767351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.767351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > address_group after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.767743 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > address_group after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.767860 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.768254 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102156) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 11 14:14:53.768630 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] ML2 OVO RPC backend initialized. {{(pid=102156) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 11 14:14:53.769328 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.769678 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.770087 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.770429 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > networks before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.771392 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.771732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > ports before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.772071 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.772407 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnets before_response 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.772750 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.773081 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.773411 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.773740 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.774069 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.774404 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.774735 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.775066 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.775424 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.775997 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.plugin [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Modular L2 Plugin initialization complete Nov 11 14:14:53.776322 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading services supported by the core plugin {{(pid=102156) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 11 14:14:53.776642 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.plugins.ml2.managers [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Got port-security extension from driver 'port_security' Nov 11 14:14:53.777101 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.extensions.vlantransparent [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Disabled vlantransparent extension. Nov 11 14:14:53.777583 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102156) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 11 14:14:53.777890 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: router Nov 11 14:14:53.820697 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.821089 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_create 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.821457 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router before_create 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.821819 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.822189 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.822543 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_delete 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.822896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.823358 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.823736 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_create 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.824078 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.824423 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.824764 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.825115 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.825523 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.825887 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.826222 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.826556 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: subnet after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.826895 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.827238 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.827606 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_create 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.827947 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.828284 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.828636 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router after_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.828974 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.829320 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_create 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.829675 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.830016 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_update 55549900 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.830373 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > agent after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.830717 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > agent after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.831058 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > network after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.831936 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Tracking information for resource: router configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:53.832264 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Tracking information for resource: floatingip configured {{(pid=102156) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 11 14:14:53.840860 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.db.l3_agentschedulers_db [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 11 14:14:53.841428 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.841784 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.842133 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.842483 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: port after_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.843266 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router before_create 55550100 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.843656 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.844020 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_create 55550100 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.844373 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > router precommit_update 55550100 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.849765 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.provider_configuration [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service providers = [] {{(pid=102156) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 11 14:14:53.850128 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.db.servicetype_db [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102156) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 11 14:14:53.853085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.service_base [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102156) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 14:14:53.853433 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.service_base [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102156) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 14:14:53.853775 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.service_base [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102156) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 14:14:53.854654 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.services.service_base [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102156) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 11 14:14:53.855025 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.services.service_base [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 11 14:14:53.855417 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.855734 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 11 14:14:53.867737 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.868069 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: auto_allocate Nov 11 14:14:53.873797 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: network precommit_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.887869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: network precommit_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.887869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.887869 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: tag Nov 11 14:14:53.894119 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.894443 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: timestamp Nov 11 14:14:53.898765 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.899094 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: network_ip_availability Nov 11 14:14:53.904560 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.905184 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.905541 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:53.906245 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.906569 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: flavors Nov 11 14:14:53.912281 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.912607 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading Plugin: revisions Nov 11 14:14:53.916908 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102156) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 11 14:14:53.917293 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.245s {{(pid=102156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 14:14:53.918034 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102156) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 11 14:14:53.918369 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Initializing extension manager. Nov 11 14:14:53.918878 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: __init__.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.919215 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: __pycache__ {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.919568 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.919896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: address_group.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.920647 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.921217 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: address-group Nov 11 14:14:53.921534 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: address_scope.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.922243 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.922755 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: address-scope Nov 11 14:14:53.923073 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.924021 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.924534 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: router-admin-state-down-before-update Nov 11 14:14:53.924851 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: agent.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.925542 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.926043 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: agent Nov 11 14:14:53.926363 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: agent_resources_synced.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.927292 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.927822 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: agent-resources-synced Nov 11 14:14:53.928137 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: allowedaddresspairs.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.929919 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.930445 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: allowed-address-pairs Nov 11 14:14:53.930768 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: auto_allocated_topology.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.931868 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.932389 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: auto-allocated-topology Nov 11 14:14:53.932711 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: availability_zone.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.933401 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.933904 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: availability_zone Nov 11 14:14:53.934244 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: availability_zone_filter.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.935127 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.935657 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: availability_zone_filter Nov 11 14:14:53.935977 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: data_plane_status.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.936881 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.937391 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension data-plane-status not supported by any of loaded plugins Nov 11 14:14:53.937715 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: default_subnetpools.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.938618 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.939128 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: default-subnetpools Nov 11 14:14:53.939471 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.940268 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.940777 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: dhcp_agent_scheduler Nov 11 14:14:53.941097 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: dns.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.942007 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.942510 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension dns-integration not supported by any of loaded plugins Nov 11 14:14:53.942846 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: dns_domain_ports.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.943785 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.944290 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 11 14:14:53.944607 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.945524 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.946026 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 11 14:14:53.946344 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: dvr.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.947009 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.947547 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: dvr Nov 11 14:14:53.947862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: ecmp_routes.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.948765 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.949265 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 11 14:14:53.949583 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: empty_string_filtering.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.955281 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.955809 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: empty-string-filtering Nov 11 14:14:53.956144 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.957040 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.957543 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 11 14:14:53.957860 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.959276 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.959804 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 11 14:14:53.960123 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: external_net.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.961031 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.961539 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: external-net Nov 11 14:14:53.961862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.962759 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.963267 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: extra_dhcp_opt Nov 11 14:14:53.963613 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: extraroute.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.964516 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.965064 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: extraroute Nov 11 14:14:53.965383 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: extraroute_atomic.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.966411 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.966919 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: extraroute-atomic Nov 11 14:14:53.967237 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: filter_validation.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.968084 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.968597 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: filter-validation Nov 11 14:14:53.968909 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: fip_pf_description.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.969814 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.970322 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 11 14:14:53.970639 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: fip_port_details.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.971582 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.972095 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: fip-port-details Nov 11 14:14:53.972411 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: flavors.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.973632 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.974700 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: flavors Nov 11 14:14:53.975018 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.976725 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.977241 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 11 14:14:53.977566 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: floatingip_pools.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.978263 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.978784 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: floatingip-pools Nov 11 14:14:53.979105 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: ip_allocation.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.984174 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.984682 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension ip_allocation not supported by any of loaded plugins Nov 11 14:14:53.984995 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.985926 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.986437 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: ip-substring-filtering Nov 11 14:14:53.986759 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l2_adjacency.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.987714 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.988224 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 11 14:14:53.988540 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.989524 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.990036 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: router Nov 11 14:14:53.990356 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.992634 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.993161 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 11 14:14:53.993488 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.994419 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.994939 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: ext-gw-mode Nov 11 14:14:53.995257 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.996200 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.996712 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: l3-ha Nov 11 14:14:53.997032 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3_flavors.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.997939 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:53.998444 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: l3-flavors Nov 11 14:14:53.998763 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:53.999704 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.000216 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 11 14:14:54.000536 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: l3agentscheduler.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.001608 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.002071 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: l3_agent_scheduler Nov 11 14:14:54.002393 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: logging.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.003901 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.004420 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension logging not supported by any of loaded plugins Nov 11 14:14:54.011137 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: metering.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.011137 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.011137 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: metering Nov 11 14:14:54.011137 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.012144 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.012665 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: metering_source_and_destination_fields Nov 11 14:14:54.012988 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: multiprovidernet.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.013907 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.014417 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: multi-provider Nov 11 14:14:54.014735 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: netmtu.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.015672 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.016182 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: net-mtu Nov 11 14:14:54.016500 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: netmtu_writable.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.017417 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.017925 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: net-mtu-writable Nov 11 14:14:54.018245 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: network_availability_zone.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.018911 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.019450 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: network_availability_zone Nov 11 14:14:54.019773 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: network_ip_availability.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.021397 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.021912 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: network-ip-availability Nov 11 14:14:54.022237 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: network_segment_range.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.022999 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.023532 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension network-segment-range not supported by any of loaded plugins Nov 11 14:14:54.023853 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: pagination.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.029131 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.029461 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: pagination Nov 11 14:14:54.029782 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: port_device_profile.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.030951 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.031494 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: port-device-profile Nov 11 14:14:54.031815 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.032727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.033236 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: port-mac-address-regenerate Nov 11 14:14:54.033556 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.034476 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.034988 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: port-numa-affinity-policy Nov 11 14:14:54.035307 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: port_resource_request.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.036246 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.036800 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension port-resource-request not supported by any of loaded plugins Nov 11 14:14:54.037147 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: port_resource_request_groups.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.038594 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.039102 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 11 14:14:54.039449 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: portbindings.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.040378 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.040894 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: binding Nov 11 14:14:54.041219 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: portbindings_extended.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.042499 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.043017 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: binding-extended Nov 11 14:14:54.043343 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: portsecurity.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.044276 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.044791 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: port-security Nov 11 14:14:54.045114 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: project_id.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.046091 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.046417 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: project-id Nov 11 14:14:54.046736 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: providernet.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.047686 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.048226 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: provider Nov 11 14:14:54.048525 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.052198 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.052718 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos not supported by any of loaded plugins Nov 11 14:14:54.053043 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.054292 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.054808 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 11 14:14:54.055138 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.056079 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.056592 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 11 14:14:54.056915 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_default.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.057826 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.058338 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-default not supported by any of loaded plugins Nov 11 14:14:54.058660 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_fip.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.059314 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.059858 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-fip not supported by any of loaded plugins Nov 11 14:14:54.060181 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_gateway_ip.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.061101 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.061615 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 11 14:14:54.061930 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_port_network_policy.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.062835 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.063346 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 11 14:14:54.063685 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.068585 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.069095 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 11 14:14:54.069413 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_pps_rule.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.070607 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.071298 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-pps not supported by any of loaded plugins Nov 11 14:14:54.071642 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_rule_type_details.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.072563 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.073073 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 11 14:14:54.073392 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: qos_rules_alias.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.074432 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.075012 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 11 14:14:54.075259 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: quota_check_limit.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.076196 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.076706 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: quota-check-limit Nov 11 14:14:54.077028 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: quotasv2.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.077956 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.078282 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: quotas Nov 11 14:14:54.078601 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: quotasv2_detail.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.081765 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.082107 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: quota_details Nov 11 14:14:54.082437 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: rbac.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.084172 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.084702 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: rbac-policies Nov 11 14:14:54.085032 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: rbac_address_group.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.085964 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.086482 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: rbac-address-group Nov 11 14:14:54.086805 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: rbac_address_scope.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.087750 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.088371 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: rbac-address-scope Nov 11 14:14:54.088595 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: rbac_security_groups.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.089513 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.090027 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: rbac-security-groups Nov 11 14:14:54.090346 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: rbac_subnetpool.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.091258 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.091807 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: rbac-subnetpool Nov 11 14:14:54.092130 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: revisionifmatch.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.102723 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.103232 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: revision-if-match Nov 11 14:14:54.103585 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: revisions.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.104696 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.105204 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: standard-attr-revisions Nov 11 14:14:54.105525 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: router_availability_zone.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.106195 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.106704 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: router_availability_zone Nov 11 14:14:54.107023 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: routerservicetype.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.107972 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.108484 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension router-service-type not supported by any of loaded plugins Nov 11 14:14:54.108804 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.109723 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.110236 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: security-groups-normalized-cidr Nov 11 14:14:54.110556 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.111583 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.112094 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: port-security-groups-filtering Nov 11 14:14:54.112412 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.113331 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.113843 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: security-groups-remote-address-group Nov 11 14:14:54.114163 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.115111 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.115652 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: security-groups-shared-filtering Nov 11 14:14:54.115973 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.116572 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 11 14:14:54.116890 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: securitygroup.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.126804 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.130772 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: security-group Nov 11 14:14:54.130772 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: segment.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.130772 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.130772 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension segment not supported by any of loaded plugins Nov 11 14:14:54.130772 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.131304 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.131780 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 11 14:14:54.132099 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: servicetype.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.133232 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.133754 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: service-type Nov 11 14:14:54.134083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: sorting.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.135064 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.135413 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: sorting Nov 11 14:14:54.135737 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: standard_attr_segment.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.136659 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.137168 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 11 14:14:54.137488 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: standardattrdescription.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.138144 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.138650 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: standard-attr-description Nov 11 14:14:54.138968 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: stateful_security_group.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.139924 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.140441 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: stateful-security-group Nov 11 14:14:54.140759 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: stdattrs_common.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.141329 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 11 14:14:54.141650 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.142565 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.143087 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 11 14:14:54.143428 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnet_onboard.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.148828 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.149341 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: subnet_onboard Nov 11 14:14:54.149659 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.150584 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.151115 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 11 14:14:54.151441 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnet_service_types.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.152362 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.152875 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: subnet-service-types Nov 11 14:14:54.153196 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnetallocation.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.154284 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.154797 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: subnet_allocation Nov 11 14:14:54.155384 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.156066 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.156578 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: subnetpool-prefix-ops Nov 11 14:14:54.156897 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.157849 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.158356 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 11 14:14:54.158677 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: tagging.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.159781 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.160298 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: standard-attr-tag Nov 11 14:14:54.160623 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: timestamp.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.161862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.162373 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loaded extension: standard-attr-timestamp Nov 11 14:14:54.162694 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: trunk.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.163784 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.164302 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension trunk not supported by any of loaded plugins Nov 11 14:14:54.164623 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: trunk_details.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.165538 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.166049 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension trunk-details not supported by any of loaded plugins Nov 11 14:14:54.166365 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: uplink_status_propagation.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.167279 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.167820 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 11 14:14:54.168135 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Loading extension file: vlantransparent.py {{(pid=102156) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 11 14:14:54.168803 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102156) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 11 14:14:54.169311 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 11 14:14:54.171818 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:network Nov 11 14:14:54.175290 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnet Nov 11 14:14:54.175290 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 14:14:54.175290 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:port Nov 11 14:14:54.175290 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.175290 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service FLAVORS assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.175769 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.175851 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.176177 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:router Nov 11 14:14:54.176620 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 14:14:54.177144 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service METERING assigned prefix: /metering {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.178595 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:54.178962 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:54.179311 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102156) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:14:54.180350 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 14:14:54.180791 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:security_group Nov 11 14:14:54.181231 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 14:14:54.181840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service CORE assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.182168 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 14:14:54.182514 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] subnetpool is already registered Nov 11 14:14:54.182956 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service CORE assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.183285 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 14:14:54.183643 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] subnetpool is already registered Nov 11 14:14:54.186025 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.186461 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service FLAVORS assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.187093 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.187566 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.187900 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:router Nov 11 14:14:54.188241 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] router is already registered Nov 11 14:14:54.188658 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:floatingip Nov 11 14:14:54.188994 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] floatingip is already registered Nov 11 14:14:54.189472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service METERING assigned prefix: /metering {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.190185 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of CountableResource for resource:rbac_policy Nov 11 14:14:54.190509 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] rbac_policy is already registered Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:security_group Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] security_group is already registered Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] security_group_rule is already registered Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service CORE assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] subnetpool is already registered Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.v2.resource_helper [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Service CORE assigned prefix: {{(pid=102156) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 11 14:14:54.194430 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Creating instance of TrackedResource for resource:subnetpool Nov 11 14:14:54.195037 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING neutron.quota.resource_registry [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] subnetpool is already registered Nov 11 14:14:54.196395 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: extensions {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.197888 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: address-groups {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.199406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: address-scopes {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.200629 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: agents {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.201893 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: auto-allocated-topology {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.203153 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: availability_zones {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.204407 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: dhcp-networks {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.205836 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: dhcp-agents {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.207387 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: routers {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.210210 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: flavors {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.211512 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: service_profiles {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.212758 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: next_providers {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.214247 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: service_profiles {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.215732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: floatingip-pools {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.217073 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: routers {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.219209 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: floatingips {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.220539 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: l3-routers {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.221947 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: l3-agents {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.223389 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: metering-labels {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.224680 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: metering-label-rules {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.226052 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: network-ip-availabilities {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.227330 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: bindings {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.228986 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: quotas {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.230650 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: quotas {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.232292 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: rbac-policies {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.233493 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: security-groups {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.234850 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: security-group-rules {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.236125 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: service-providers {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.240222 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: subnetpools {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.240222 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: subnetpools {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.240222 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.242100 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.243952 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.245748 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.247493 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.249472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.251179 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.254050 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.256341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.258107 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron.api.extensions [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Extended resource: tags {{(pid=102156) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 11 14:14:54.264296 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING keystonemiddleware.auth_token [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 14:14:54.268793 dv-cinder-777031-9-iscsi neutron-server[102156]: WARNING keystonemiddleware.auth_token [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 14:14:54.278182 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Acquired lock "singleton_lock" {{(pid=102156) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 14:14:54.278655 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_concurrency.lockutils [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Releasing lock "singleton_lock" {{(pid=102156) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 14:14:54.279300 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Starting 2 workers Nov 11 14:14:54.284411 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Started child 102267 {{(pid=102156) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 14:14:54.288918 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Started child 102268 {{(pid=102156) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 14:14:54.289884 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.290736 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO neutron.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 11 14:14:54.291067 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Publish callbacks [] for process, before_spawn {{(pid=102156) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.291345 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [-] (102267) wsgi starting up on http://0.0.0.0:9696 Nov 11 14:14:54.293502 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Starting 1 workers Nov 11 14:14:54.293673 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.295060 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [-] (102268) wsgi starting up on http://0.0.0.0:9696 Nov 11 14:14:54.298745 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Started child 102269 {{(pid=102156) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 14:14:54.299288 dv-cinder-777031-9-iscsi neutron-server[102156]: INFO oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Starting 1 workers Nov 11 14:14:54.302550 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] calling RpcWorker wait() {{(pid=102269) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 11 14:14:54.303447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] returning from RpcWorker wait() {{(pid=102269) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 11 14:14:54.303836 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Started child 102270 {{(pid=102156) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 11 14:14:54.304506 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.304625 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG neutron_lib.callbacks.manager [None req-402e3e24-bbf9-40be-96b4-e34646b76046 None None] Publish callbacks [] for process, after_spawn {{(pid=102156) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.305047 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:14:54.306540 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102156) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 11 14:14:54.306754 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 14:14:54.307123 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 14:14:54.307383 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 14:14:54.307732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 14:14:54.307914 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 14:14:54.308452 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.308734 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:14:54.309202 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.309202 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.309329 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.309514 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.309913 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:14:54.310048 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.310491 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.310761 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.311038 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.311293 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.311483 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.311660 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.311886 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.312115 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.312411 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.312686 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.312941 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.313196 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.313367 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.313607 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.313869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.314123 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.314395 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] debug = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.314650 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.315119 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.315345 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.315625 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.315868 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.316148 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.316378 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.316629 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.316870 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.317092 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.317336 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.318152 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.318398 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.318617 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.318840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.319053 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.319296 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.319558 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.320024 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] host = dv-cinder-777031-9-iscsi {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.320273 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.320478 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.320704 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.320956 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.321201 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.321413 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.321669 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.321924 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.322163 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.322387 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.322646 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.322906 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.323138 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.323413 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.323580 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_options = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.323824 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.324096 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.324355 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.324545 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.324712 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.324884 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.325152 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.325313 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.325579 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.325792 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.326003 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.326213 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.326446 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.326659 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.326893 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.327119 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.327343 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.327607 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.327862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.328101 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.328304 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.328526 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.328771 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.329014 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.329227 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.329505 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.329713 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.329930 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.330168 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.330400 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.330640 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.330876 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.331109 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.331336 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.331628 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.331873 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.332102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.332331 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.332609 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.332831 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.333095 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.333914 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.334212 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.334358 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.334622 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.334835 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.335065 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_json = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.335286 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.335541 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.335787 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.336018 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.336233 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.336444 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.336653 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.336896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.337327 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.337594 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.337897 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.338155 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.338406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.338657 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.338884 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.339100 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.339393 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.339628 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.340115 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.340370 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.340753 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.340892 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.341142 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.341442 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.341715 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.341986 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.342223 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.342462 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.342675 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.342920 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.343202 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.343441 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.343691 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.343919 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.344137 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.344473 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.344746 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.345197 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.10/identity {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.345463 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.345684 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.345976 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.346174 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.346484 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.346922 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.347164 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.347427 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.347681 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.347917 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.348136 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.348364 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.348580 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.348836 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.349078 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.349345 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.349575 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.349816 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.350031 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.350357 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.350664 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.351322 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.351839 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.351839 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.351839 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.352317 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.352317 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.352590 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.352739 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.352960 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.353486 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.353486 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.353768 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.353938 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.354082 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.356083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359085 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.359727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.360190 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.360190 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.360324 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.360557 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.360798 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.361014 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.361251 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.361692 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.362097 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.362545 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.362993 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.363451 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.363865 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.364097 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.364343 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.364630 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.364876 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.365132 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.365372 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.365609 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.365831 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.366265 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.366502 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.366756 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.367020 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.367248 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.367536 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.367984 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.368424 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.368643 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.368910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.369320 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.369690 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.369997 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.370214 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.370443 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.370700 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.370969 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.371231 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.371510 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.371742 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.372004 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.372420 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.372668 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.373075 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.373456 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.373681 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.374203 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.374433 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.374647 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.374858 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.375132 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.375414 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.375680 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.375946 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.376183 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.376409 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.376663 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.376898 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.10/identity {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.377109 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.377340 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.377564 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.377796 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.378067 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.378262 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.378475 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.378690 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.378901 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.379148 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.379359 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.379628 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.379870 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.380627 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.380869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.381115 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.381329 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.381548 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.381812 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.382041 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.382209 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.382442 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.382652 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.382895 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.383111 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.383388 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387176 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.387840 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388638 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.388914 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.389030 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.389172 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.389552 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.389773 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.390031 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.390260 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.390481 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.390690 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.390902 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.391435 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.391435 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.391653 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.391858 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.392112 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.392350 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.392591 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.392839 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.393050 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.393278 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.393484 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.393724 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.393912 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.394148 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.394357 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.394603 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.394810 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.395016 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.395232 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.395466 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.395732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.396517 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.396727 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.396936 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.397177 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.397390 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.397596 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.397820 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.398025 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.398229 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.398446 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.398658 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.398864 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.399089 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.399295 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.399523 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.399742 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.400546 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.400546 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.400546 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.400910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.400910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.401181 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.401421 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.401666 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.401946 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.402229 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.402478 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.402722 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.402953 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.403185 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.403497 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.403750 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.404074 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.404381 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.404613 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.404841 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.405355 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.405647 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.405907 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.406118 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.406423 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.406751 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.407021 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.407291 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.407553 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.407800 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.408038 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.408269 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.408502 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.408733 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.408945 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.409214 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.409439 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.409660 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.409891 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.410112 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.410343 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.410584 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.410814 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.411168 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.411680 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.411875 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 14:14:54.412392 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102156) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 11 14:14:54.412550 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 14:14:54.412708 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 14:14:54.412870 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 14:14:54.413494 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 14:14:54.413494 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 14:14:54.413494 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.413494 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.413976 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.413976 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.413976 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414254 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414254 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414506 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414631 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414754 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414837 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.414966 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415122 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415277 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415471 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415628 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415785 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.415942 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416103 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416259 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416415 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416570 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416724 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] debug = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.416862 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417062 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417217 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417531 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417689 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417845 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.417999 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.418156 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.418311 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.418464 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.418607 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419101 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419101 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419101 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419472 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419746 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419873 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] host = dv-cinder-777031-9-iscsi {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.419988 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420110 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420193 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420352 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420508 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420662 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420822 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.420977 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421133 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421288 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421442 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421597 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421752 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.421905 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422060 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_options = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422215 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422369 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422524 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422711 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.422871 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423027 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423182 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423337 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423559 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423656 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423807 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.423969 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424120 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424262 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424403 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424534 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424675 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424811 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.424969 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425113 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425257 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425409 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425564 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425719 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.425875 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426028 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426182 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426338 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426492 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426646 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426800 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.426979 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427136 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427292 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427503 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427618 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427771 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.427925 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428083 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428240 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428395 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428548 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428703 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.428858 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429013 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429168 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429322 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_json = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429477 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429631 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429785 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.429940 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.430094 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.430248 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.430403 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.430559 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 14:14:54.430769 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.430887 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431042 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431199 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431357 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431537 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431695 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.431852 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432009 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432167 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432332 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432489 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432715 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.432875 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433032 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433193 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433351 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433510 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433669 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433827 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.433985 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434143 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434309 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434466 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434623 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434780 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.434941 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435115 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435272 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435454 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.10/identity {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435615 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435772 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.435930 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436088 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436246 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436404 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436563 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436719 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.436877 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437035 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437191 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437348 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437505 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437664 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437822 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.437980 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438136 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438293 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438451 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438608 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438766 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.438923 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439080 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439238 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439409 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439580 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439737 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.439894 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440050 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440207 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440362 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440519 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440675 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.440886 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.441910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.441910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.441910 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443642 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443642 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443642 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.443642 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444313 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444389 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444547 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444697 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444845 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.444986 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445211 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445348 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445478 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445625 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445760 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.445923 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446063 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446195 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446325 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446475 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446633 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446791 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.446947 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447105 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447263 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447443 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447606 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447827 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.447952 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448077 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448199 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448355 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448512 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448669 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448826 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.448984 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449141 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449298 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449459 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449637 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449764 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.449928 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450500 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450500 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450500 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450844 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450844 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.450844 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451051 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451175 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451299 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451460 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451966 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451966 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.451966 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452285 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452285 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452480 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452562 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452678 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452808 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.452966 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453150 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453315 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453453 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453596 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453730 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.453894 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.10/identity {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.455406 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456341 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456888 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456888 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.456888 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457102 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457244 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457379 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457542 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457708 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457829 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.457992 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.458171 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.458902 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.459063 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.459217 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.459389 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.459566 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.459723 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460039 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460208 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460353 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460503 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460656 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460806 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.460945 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461076 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461230 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461392 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461551 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461708 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.461869 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462027 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462185 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462508 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462638 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462761 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.462896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463020 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463143 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463293 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463475 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463634 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463793 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.463949 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464108 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464271 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464429 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464586 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464743 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.464900 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465058 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465216 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465425 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465525 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465688 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.465846 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466005 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466107 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:14:54.466193 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466319 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466476 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466634 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466792 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.466948 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467105 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467272 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467460 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467620 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467777 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.467935 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468093 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468259 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468417 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468575 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468732 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.468889 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469046 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469211 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469368 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469526 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469683 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469855 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.469985 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470151 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470309 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470466 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470623 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470780 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.470938 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471104 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471267 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471451 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471621 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.471936 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472093 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472262 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472420 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472581 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472738 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.472896 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473055 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473216 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473377 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473542 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473705 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.473900 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474066 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474232 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:300:349'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474399 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474557 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474721 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.474890 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475046 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475204 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475379 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475538 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475695 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.475854 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.476011 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.476168 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.476326 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.476486 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.476643 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.477778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.477778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.477778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.477778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.477778 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.478509 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.478509 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.478509 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 14:14:54.478509 dv-cinder-777031-9-iscsi neutron-server[102156]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 14:14:54.617487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 55806) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:14:54.625952 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [-] 10.222.0.10 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0063758 Nov 11 14:15:06.035466 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b5cadb0-b8ac-4705-a8c2-85db78b3e557 None None] get_active_networks_info from dv-cinder-777031-9-iscsi {{(pid=102269) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 11 14:15:06.166581 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b5cadb0-b8ac-4705-a8c2-85db78b3e557 None None] No non-hosted networks {{(pid=102269) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 11 14:15:06.214260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.agentschedulers_db [None req-0b5cadb0-b8ac-4705-a8c2-85db78b3e557 None None] DHCP Agent not found on host dv-cinder-777031-9-iscsi {{(pid=102269) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 11 14:15:06.413476 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-eafd3a68-e112-410c-9caa-9c7dd4bcacfc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:08.451337 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a60e0981-f7d4-4378-8152-411069148008 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:08.489406 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.db.api [None req-54ae74d3-fe49-498f-8f41-cc189d8612ea None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-777031-9-iscsi {{(pid=102269) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 11 14:15:08.489830 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG oslo_db.api [None req-54ae74d3-fe49-498f-8f41-cc189d8612ea None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 11 14:15:09.105653 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-54ae74d3-fe49-498f-8f41-cc189d8612ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:09.643007 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:10.729785 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:11.705497 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:11.706155 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.706512 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.706840 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.707159 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.707625 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.708485 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.708806 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.709150 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.709503 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.709820 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.710148 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.710486 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:11.710861 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-777031-9-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:11.717634 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-777031-9-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:12.215251 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 55898) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:12.744062 dv-cinder-777031-9-iscsi neutron-server[102267]: WARNING oslo_policy.policy [None req-86fc7cff-e5ef-4b7a-b06b-7c62da698ecc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:12.744710 dv-cinder-777031-9-iscsi neutron-server[102267]: WARNING oslo_policy.policy [None req-86fc7cff-e5ef-4b7a-b06b-7c62da698ecc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:12.975749 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [None req-86fc7cff-e5ef-4b7a-b06b-7c62da698ecc admin admin] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:15:12.991406 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-86fc7cff-e5ef-4b7a-b06b-7c62da698ecc admin admin] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7598462 Nov 11 14:15:14.934848 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.db.l3_hamode_db [None req-66406622-976a-4773-9571-cd931b8c8cc2 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 11 14:15:15.011888 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66406622-976a-4773-9571-cd931b8c8cc2 None None] Routers set() bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:15:15.012275 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66406622-976a-4773-9571-cd931b8c8cc2 None None] Router IDs set() for agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 11 14:15:15.460443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 55914) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:15.774960 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] Request body: {'subnetpool': {'shared': True, 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:15.870297 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.policy [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102267) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 11 14:15:15.917794 dv-cinder-777031-9-iscsi neutron-server[102267]: WARNING oslo_policy.policy [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:15.918156 dv-cinder-777031-9-iscsi neutron-server[102267]: WARNING oslo_policy.policy [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:15.926820 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.quota [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] Loaded quota_driver: . Nov 11 14:15:16.060474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764487465736', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764487465317', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764487437095', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764487450584', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764490041146', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8764487492623', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3465734', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-574616', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3740656', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3569048'] for rbac-policy, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:16.204174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:16.205349 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-344efa77-f44f-419d-989c-935ce0021c7d admin admin] 10.222.0.10 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.7438979 Nov 11 14:15:18.867216 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 55926) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:19.158443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Request body: {'network': {'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'name': 'private', 'admin_state_up': True, 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:19.243335 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Made reservation on behalf of 15b8b2c081c84adf90f282a7f0b285df for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:15:19.246073 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.262341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.366052 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.420571 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.439098 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 326} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:15:19.468008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8764490884316', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.468577 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Unsubscribe: segment precommit_create {{(pid=102267) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 11 14:15:19.469088 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Added segment 4bfb3e8f-9fdb-403d-853c-4abbfe3fe582 of type vlan for network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 Nov 11 14:15:19.484801 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=028e2a05-6192-4616-9602-abd135e3f49c,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:19.535394 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.536328 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.536666 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.536992 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.537317 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.537654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.537981 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.538318 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.538647 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.538963 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.539274 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.539614 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Tracked resource versions report: Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: pushed versions: Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: { 'AddressGroup': {'1.2'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'ConntrackHelper': {'1.0'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Log': {'1.0'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Network': {'1.1'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Port': {'1.7'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'PortForwarding': {'1.2'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'QosPolicy': {'1.10'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroup': {'1.5'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SubPort': {'1.0'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Subnet': {'1.1'}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Trunk': {'1.1'}} Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: consumer versions: Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'ConntrackHelper': '1.0', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Log': '1.0', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Network': '1.1', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Port': '1.7', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'PortForwarding': '1.2', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'QosPolicy': '1.10', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroup': '1.5', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroupRule': '1.2', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SubPort': '1.0', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Subnet': '1.1', Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Trunk': '1.1'}} Nov 11 14:15:19.546468 dv-cinder-777031-9-iscsi neutron-server[102267]: {{(pid=102267) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:15:19.585244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.705509 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.706745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:19.707879 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:19.804871 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] Pushing event updated for resources: {'Network': ['ID=90af38f1-ccb9-47ec-b23d-bdc77879fa69,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:19.816261 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:15:19.822101 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e3df5f11-864a-4e95-aef8-50b439ab8f66 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.9538279 Nov 11 14:15:22.564967 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 55940) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:22.952244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8145d3bc-5bdd-4293-bd16-a1b5e973f014 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:22.953588 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-8145d3bc-5bdd-4293-bd16-a1b5e973f014 admin admin] 10.222.0.10 "GET /v2.0/networks/90af38f1-ccb9-47ec-b23d-bdc77879fa69 HTTP/1.1" status: 200 len: 825 time: 0.3876777 Nov 11 14:15:22.978922 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-f7107bd7-92de-48c8-9b1e-9c608b58cabf admin admin] 10.222.0.10 "GET /v2.0/subnetpools/e6b75648-02e7-4256-879f-c9d250ea9f9f HTTP/1.1" status: 200 len: 734 time: 0.0183685 Nov 11 14:15:22.988184 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Request body: {'subnet': {'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f', 'ip_version': 4, 'name': 'private-subnet', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'gateway_ip': '172.20.0.1'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:23.066003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Made reservation on behalf of 15b8b2c081c84adf90f282a7f0b285df for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:15:23.068281 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:23.420951 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:23.492606 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Pushing event updated for resources: {'Subnet': ['ID=69c5cec9-092b-4f7f-8b90-d72e44c5bc34,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:23.494594 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Checking segment: {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:15:23.494966 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Network hostable DHCP agents. Network: 90af38f1-ccb9-47ec-b23d-bdc77879fa69, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:15:23.603385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:15:23.689153 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 90af38f1-ccb9-47ec-b23d-bdc77879fa69) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:23.699571 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:23.699571 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:23.704109 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-431855b1-91cf-4117-9667-057ee9779814 None None] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:15:23.777828 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4d75f06c-3a8d-4ad9-8a05-1e9f7bf4ad82 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7928813 Nov 11 14:15:24.028795 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:15:24.030291 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:24.325701 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Allocated IP 172.20.0.2 (90af38f1-ccb9-47ec-b23d-bdc77879fa69/69c5cec9-092b-4f7f-8b90-d72e44c5bc34/c6f605b6-3f0f-40a5-92c7-145cf4a24e22) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:15:24.525418 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:24.621809 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:24.703470 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:15:24.711396 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:24.713860 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Pushing event updated for resources: {'Port': ['ID=c6f605b6-3f0f-40a5-92c7-145cf4a24e22,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:24.716144 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:15:24.728341 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.728689 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.729023 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.729349 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.729664 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.729981 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.730415 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.730730 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.731063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.731392 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.731776 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.732089 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Tracked resource versions report: Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: pushed versions: Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: { 'AddressGroup': {'1.2'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'ConntrackHelper': {'1.0'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Log': {'1.0'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Network': {'1.1'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Port': {'1.7'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'PortForwarding': {'1.2'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'QosPolicy': {'1.10'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroup': {'1.5'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SubPort': {'1.0'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Subnet': {'1.1'}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Trunk': {'1.1'}} Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: consumer versions: Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'ConntrackHelper': '1.0', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Log': '1.0', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Network': '1.1', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Port': '1.7', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'PortForwarding': '1.2', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'QosPolicy': '1.10', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroup': '1.5', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroupRule': '1.2', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SubPort': '1.0', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Subnet': '1.1', Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Trunk': '1.1'}} Nov 11 14:15:24.733181 dv-cinder-777031-9-iscsi neutron-server[102269]: {{(pid=102269) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:15:24.806858 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Attempting to bind port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:15:24.807241 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Attempting to bind port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:15:24.807696 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Attempting to bind port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 on network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:15:24.812738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 15, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:15:24.813175 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Checking segment: {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:15:24.813645 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:24.814028 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Bound using segment: {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:15:24.814648 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Bound port: c6f605b6-3f0f-40a5-92c7-145cf4a24e22, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:15:24.815066 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:24.878480 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] For port c6f605b6-3f0f-40a5-92c7-145cf4a24e22, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:15:24.882783 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] For port c6f605b6-3f0f-40a5-92c7-145cf4a24e22, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=c6f605b6-3f0f-40a5-92c7-145cf4a24e22,segment=NetworkSegment(4bfb3e8f-9fdb-403d-853c-4abbfe3fe582),segment_id=4bfb3e8f-9fdb-403d-853c-4abbfe3fe582)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:15:24.976070 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:25.046562 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3022f69d-53d7-4469-93b1-713f2379adec None None] Pushing event updated for resources: {'Port': ['ID=c6f605b6-3f0f-40a5-92c7-145cf4a24e22,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:26.400238 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 55948) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:26.882013 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING oslo_policy.policy [None req-59a76f0e-d8b5-49e1-9686-a0223f57d750 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:26.882669 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING oslo_policy.policy [None req-59a76f0e-d8b5-49e1-9686-a0223f57d750 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:27.108720 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [None req-59a76f0e-d8b5-49e1-9686-a0223f57d750 admin admin] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:15:27.109724 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-59a76f0e-d8b5-49e1-9686-a0223f57d750 admin admin] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7085960 Nov 11 14:15:29.632533 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 55962) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:29.948010 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [None req-e2b72368-aa82-47cd-a351-dd38706c9309 admin admin] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:15:29.948979 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e2b72368-aa82-47cd-a351-dd38706c9309 admin admin] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3154988 Nov 11 14:15:32.696345 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 55974) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:33.008422 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Request body: {'router': {'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'name': 'router1'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:33.073633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.policy [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102268) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 11 14:15:33.121985 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING oslo_policy.policy [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:33.122366 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING oslo_policy.policy [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 11 14:15:33.131224 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.quota [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Loaded quota_driver: . Nov 11 14:15:33.248395 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.250172 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.399927 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.455224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.515893 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device c6f605b6-3f0f-40a5-92c7-145cf4a24e22 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:15:33.548442 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.560085 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-cc6997a7-6334-4e74-b5c9-6b1100e3fe82 admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.8625386 Nov 11 14:15:33.614045 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:33.614606 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.730990 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.773264 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port c6f605b6-3f0f-40a5-92c7-145cf4a24e22, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=c6f605b6-3f0f-40a5-92c7-145cf4a24e22,segment=NetworkSegment(4bfb3e8f-9fdb-403d-853c-4abbfe3fe582),segment_id=4bfb3e8f-9fdb-403d-853c-4abbfe3fe582)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:15:33.899811 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:33.949260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=c6f605b6-3f0f-40a5-92c7-145cf4a24e22,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:34.136527 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b72f70c-ff90-4ecd-b5b7-9824b2daca92 None None] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:15:34.251137 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-20e8c6c7-db99-454f-ac8d-c25471723065 None None] Provisioning complete for port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:34.251531 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-20e8c6c7-db99-454f-ac8d-c25471723065 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:34.615446 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-45504a3e-093a-4966-9b09-5b084510e0e3 None None] Provisioning complete for port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:34.616110 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-45504a3e-093a-4966-9b09-5b084510e0e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:35.482970 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device c6f605b6-3f0f-40a5-92c7-145cf4a24e22 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:15:35.530408 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:35.530777 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:36.032379 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff3e57ec-9cf2-4107-9406-ed2a0db05bdc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:36.078189 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 55988) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:36.377474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [None req-72d429e1-c2de-4717-8726-3cfba190627e admin admin] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:15:36.378450 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-72d429e1-c2de-4717-8726-3cfba190627e admin admin] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2993188 Nov 11 14:15:38.430454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-f947ce46-03da-4efb-a2ef-020b89fa53ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:38.832608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 55996) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:39.140258 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'name': 'public', 'admin_state_up': True, 'is_default': True, 'provider:physical_network': 'physnet1', 'router:external': True}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:39.231947 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Made reservation on behalf of 942a10d16bdc48d1b94f6764e5c615c8 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:15:39.234125 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.242749 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.312726 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.414455 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.431235 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Reserving flat network on physical network physnet1 {{(pid=102267) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 11 14:15:39.447448 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f673673-49b7-4d47-8e11-5c56f6bc8e27,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:39.452058 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.452401 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Added segment ccf60016-3240-46fc-a3a3-4c5e7de68220 of type flat for network 2695a271-995b-4caa-b664-bb0645c2bc02 Nov 11 14:15:39.506419 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.552262 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.586055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.586971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:39.587567 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:39.643793 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] Pushing event updated for resources: {'Network': ['ID=2695a271-995b-4caa-b664-bb0645c2bc02,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:39.653182 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 2695a271-995b-4caa-b664-bb0645c2bc02 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:15:39.663296 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a4970839-14d8-4302-9ad3-981a7061ecc0 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8296535 Nov 11 14:15:40.620372 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:41.689189 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:42.135693 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56014) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:42.361425 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28512e76-5492-4e47-9b59-5ee0ed4cc378 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:42.362874 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-28512e76-5492-4e47-9b59-5ee0ed4cc378 admin admin] 10.222.0.10 "GET /v2.0/subnets/69c5cec9-092b-4f7f-8b90-d72e44c5bc34 HTTP/1.1" status: 200 len: 849 time: 0.2262757 Nov 11 14:15:42.479145 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-821001f8-3629-46d2-bf5f-d8dffa2bc9c1 admin admin] 10.222.0.10 "GET /v2.0/routers/b355dc75-0f49-49cf-a143-8c76df13fa05 HTTP/1.1" status: 200 len: 704 time: 0.1094248 Nov 11 14:15:42.756076 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.058443 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Allocated IP 172.20.0.1 (90af38f1-ccb9-47ec-b23d-bdc77879fa69/69c5cec9-092b-4f7f-8b90-d72e44c5bc34/4568758d-9c4a-4751-b9c3-748def0b86b6) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:15:43.271279 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.397131 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.461802 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:15:43.466941 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:43.512877 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Pushing event updated for resources: {'Port': ['ID=4568758d-9c4a-4751-b9c3-748def0b86b6,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:43.517749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:15:43.518289 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.575711 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.576075 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.576413 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.576742 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.577050 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.577384 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.577709 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.578038 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.578375 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.578692 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.579004 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.579315 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Tracked resource versions report: Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: pushed versions: Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: { 'AddressGroup': {'1.2'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'ConntrackHelper': {'1.0'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Log': {'1.0'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Network': {'1.1'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Port': {'1.7'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'PortForwarding': {'1.2'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'QosPolicy': {'1.10'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroup': {'1.5'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SubPort': {'1.0'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Subnet': {'1.1'}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Trunk': {'1.1'}} Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: consumer versions: Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'ConntrackHelper': '1.0', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Log': '1.0', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Network': '1.1', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Port': '1.7', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'PortForwarding': '1.2', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'QosPolicy': '1.10', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroup': '1.5', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroupRule': '1.2', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SubPort': '1.0', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Subnet': '1.1', Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Trunk': '1.1'}} Nov 11 14:15:43.580442 dv-cinder-777031-9-iscsi neutron-server[102268]: {{(pid=102268) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:15:43.756722 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.758007 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-8c328bcd-2b11-4486-b19a-1e4788a427b6 None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:43.758505 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8c328bcd-2b11-4486-b19a-1e4788a427b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:43.790822 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-8c328bcd-2b11-4486-b19a-1e4788a427b6 None None] Port 4568758d-9c4a-4751-b9c3-748def0b86b6 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:15:43.967933 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:44.003039 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:44.004400 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:44.135687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Pushing event updated for resources: {'Port': ['ID=4568758d-9c4a-4751-b9c3-748def0b86b6,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:44.177788 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:15:44.179074 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:44.380665 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Router b355dc75-0f49-49cf-a143-8c76df13fa05 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:15:44.413111 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-cd5f99ff-ade4-47c0-8d89-2ebd48087e4e None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:44.413479 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-cd5f99ff-ade4-47c0-8d89-2ebd48087e4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:44.445961 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-cd5f99ff-ade4-47c0-8d89-2ebd48087e4e None None] Port 4568758d-9c4a-4751-b9c3-748def0b86b6 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:15:44.473878 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:15:44.479175 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d2aab866-3d65-4a10-ba21-ab4f20e015ba admin admin] 10.222.0.10 "PUT /v2.0/routers/b355dc75-0f49-49cf-a143-8c76df13fa05/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9930880 Nov 11 14:15:44.484162 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Sync routers for ids ['b355dc75-0f49-49cf-a143-8c76df13fa05'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:15:44.497876 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Routers {'b355dc75-0f49-49cf-a143-8c76df13fa05'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:15:44.498774 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:15:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['b355dc75-0f49-49cf-a143-8c76df13fa05'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:44.684549 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Set router b355dc75-0f49-49cf-a143-8c76df13fa05 gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:15:45.107878 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:43Z', 'revision_number': 2, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port_host': None, '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:43Z', 'revision_number': 2, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:45.158453 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Checking router: b355dc75-0f49-49cf-a143-8c76df13fa05 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:15:45.158818 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Updating router b355dc75-0f49-49cf-a143-8c76df13fa05 port 4568758d-9c4a-4751-b9c3-748def0b86b6 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:15:45.206174 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:45.704092 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:45.775216 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:45.940746 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Pushing event updated for resources: {'Port': ['ID=4568758d-9c4a-4751-b9c3-748def0b86b6,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:45.947671 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Attempting to bind port 4568758d-9c4a-4751-b9c3-748def0b86b6 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:15:45.948061 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Attempting to bind port 4568758d-9c4a-4751-b9c3-748def0b86b6 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:15:45.948497 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Attempting to bind port 4568758d-9c4a-4751-b9c3-748def0b86b6 on network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:15:45.956653 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 15, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:15:45.957490 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Checking segment: {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:15:45.957961 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:45.958340 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Bound using segment: {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:15:45.958836 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Bound port: 4568758d-9c4a-4751-b9c3-748def0b86b6, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4bfb3e8f-9fdb-403d-853c-4abbfe3fe582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 326, 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:15:45.959215 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:45.961648 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.962083 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.962331 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.962639 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.962957 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.963273 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.963614 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.963930 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.964250 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.964563 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.964873 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.965197 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Tracked resource versions report: Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: pushed versions: Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: { 'AddressGroup': {'1.2'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'ConntrackHelper': {'1.0'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Log': {'1.0'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Network': {'1.1'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Port': {'1.7'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'PortForwarding': {'1.2'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'QosPolicy': {'1.10'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroup': {'1.5'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SubPort': {'1.0'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Subnet': {'1.1'}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Trunk': {'1.1'}} Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: consumer versions: Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'ConntrackHelper': '1.0', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Log': '1.0', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Network': '1.1', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Port': '1.7', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'PortForwarding': '1.2', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'QosPolicy': '1.10', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroup': '1.5', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroupRule': '1.2', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SubPort': '1.0', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Subnet': '1.1', Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Trunk': '1.1'}} Nov 11 14:15:45.966267 dv-cinder-777031-9-iscsi neutron-server[102270]: {{(pid=102270) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:15:46.033571 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] For port 4568758d-9c4a-4751-b9c3-748def0b86b6, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:15:46.052558 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] For port 4568758d-9c4a-4751-b9c3-748def0b86b6, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=4568758d-9c4a-4751-b9c3-748def0b86b6,segment=NetworkSegment(4bfb3e8f-9fdb-403d-853c-4abbfe3fe582),segment_id=4bfb3e8f-9fdb-403d-853c-4abbfe3fe582)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:15:46.078366 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7c6552cc-3447-4d1c-ab19-bb984c11b756 None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:46.078931 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7c6552cc-3447-4d1c-ab19-bb984c11b756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:46.113070 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-7c6552cc-3447-4d1c-ab19-bb984c11b756 None None] Port 4568758d-9c4a-4751-b9c3-748def0b86b6 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:15:46.158426 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:46.216092 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Routers {'b355dc75-0f49-49cf-a143-8c76df13fa05'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:15:46.216626 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:15:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['b355dc75-0f49-49cf-a143-8c76df13fa05'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:46.255553 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d34e2d0-d3d4-4e7a-bc0c-4592931aaf3b None None] Pushing event updated for resources: {'Port': ['ID=4568758d-9c4a-4751-b9c3-748def0b86b6,revision_number=4']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:46.310425 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] Set router b355dc75-0f49-49cf-a143-8c76df13fa05 gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:15:46.433077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:46.433434 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:46.513412 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:46.527571 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:43Z', 'revision_number': 2, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port_host': None, '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:46Z', 'revision_number': 4, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:46.547565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] For port 4568758d-9c4a-4751-b9c3-748def0b86b6, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=4568758d-9c4a-4751-b9c3-748def0b86b6,segment=NetworkSegment(4bfb3e8f-9fdb-403d-853c-4abbfe3fe582),segment_id=4bfb3e8f-9fdb-403d-853c-4abbfe3fe582)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:15:46.556002 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bab7cd7-a778-4faf-aeb9-e29fa1dc6211 None None] The sync data for ids ['b355dc75-0f49-49cf-a143-8c76df13fa05'] in dv-cinder-777031-9-iscsi is: [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:43Z', 'revision_number': 2, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port_host': None, '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:46Z', 'revision_number': 4, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:15:46.619636 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:46.670516 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e3c5447-5595-4f2a-af13-85db38bf9ba6 None None] Pushing event updated for resources: {'Port': ['ID=4568758d-9c4a-4751-b9c3-748def0b86b6,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:46.830818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56038) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:46.942653 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-118288a6-515a-4ba6-80f3-6f70a2ae0d25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:46.950011 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-118288a6-515a-4ba6-80f3-6f70a2ae0d25 admin admin] 10.222.0.10 "GET /v2.0/networks/2695a271-995b-4caa-b664-bb0645c2bc02 HTTP/1.1" status: 200 len: 842 time: 0.1121638 Nov 11 14:15:46.954095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'gateway_ip': '172.27.1.1', 'name': 'public-subnet', 'cidr': '172.27.1.0/24', 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:47.072029 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Made reservation on behalf of 942a10d16bdc48d1b94f6764e5c615c8 for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:15:47.074310 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:47.453437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.objects.ports [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102268) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 11 14:15:47.453885 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:47.506206 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=872490fe-8b51-42ad-a4a2-14f82622d8e6,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:47.517708 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:15:47.518057 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Network hostable DHCP agents. Network: 2695a271-995b-4caa-b664-bb0645c2bc02, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:15:47.613376 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:15:47.712525 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 2695a271-995b-4caa-b664-bb0645c2bc02) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:47.716666 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:47.717341 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:47.722574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd87b685-457b-44f8-8c26-dfc67b9c2417 None None] Network 2695a271-995b-4caa-b664-bb0645c2bc02 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:15:47.778156 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-66d237ee-bfb6-43cf-ba0a-f24a9468a2f1 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8273852 Nov 11 14:15:47.866300 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53f59af1-6075-426c-aedd-f9a9b6d9287f None None] Network 2695a271-995b-4caa-b664-bb0645c2bc02 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:15:50.188209 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56046) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:50.450110 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1cfb62bc-71c4-4698-816a-55eaf75d7de3 admin admin] 10.222.0.10 "GET /v2.0/routers/b355dc75-0f49-49cf-a143-8c76df13fa05 HTTP/1.1" status: 200 len: 710 time: 0.2607732 Nov 11 14:15:50.565583 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d924333-ebb8-48a8-97b1-697b63975fd1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:15:50.567509 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-5d924333-ebb8-48a8-97b1-697b63975fd1 admin admin] 10.222.0.10 "GET /v2.0/networks/2695a271-995b-4caa-b664-bb0645c2bc02 HTTP/1.1" status: 200 len: 886 time: 0.1090729 Nov 11 14:15:50.576868 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:15:50.823947 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:51.117278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:51.238787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:51.411958 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Allocated IP 172.27.1.28 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/8a8ebf20-816a-4a65-b81f-aba8454a6534) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:15:51.520730 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:51.628142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:51.695058 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:15:51.703781 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:15:51.711702 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:15:51.750874 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Pushing event updated for resources: {'Port': ['ID=8a8ebf20-816a-4a65-b81f-aba8454a6534,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:52.077276 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:52.274169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-393801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-396835', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-41403'] for router, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:52.279787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-393822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-393815', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-396856'] for router, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:52.389892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Router b355dc75-0f49-49cf-a143-8c76df13fa05 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:15:52.494434 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:15:52.498754 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:52.499974 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-f3467da0-ddaf-41ae-af1b-4f147e66c6c1 admin admin] 10.222.0.10 "PUT /v2.0/routers/b355dc75-0f49-49cf-a143-8c76df13fa05 HTTP/1.1" status: 200 len: 889 time: 1.9262207 Nov 11 14:15:53.444482 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Sync routers for ids ['b355dc75-0f49-49cf-a143-8c76df13fa05'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:15:53.466586 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Routers {'b355dc75-0f49-49cf-a143-8c76df13fa05'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:15:53.467454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:15:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['b355dc75-0f49-49cf-a143-8c76df13fa05'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:53.525257 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 4568758d-9c4a-4751-b9c3-748def0b86b6 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:15:53.698798 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:53.699106 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:53.737710 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Set router b355dc75-0f49-49cf-a143-8c76df13fa05 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:15:54.219051 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28'}], 'enable_snat': True}, 'gw_port_id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:51Z', 'revision_number': 4, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port': {'id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:2f:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:51Z', 'updated_at': '2021-11-11T14:15:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:46Z', 'revision_number': 5, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:54.270107 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Checking router: b355dc75-0f49-49cf-a143-8c76df13fa05 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:15:54.270365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Updating router b355dc75-0f49-49cf-a143-8c76df13fa05 port 8a8ebf20-816a-4a65-b81f-aba8454a6534 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:15:54.316283 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.629720 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.700671 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.752544 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9eda4e-1eb1-450d-a47a-bf388f50e57c None None] Pushing event updated for resources: {'Port': ['ID=8a8ebf20-816a-4a65-b81f-aba8454a6534,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:54.757179 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Attempting to bind port 8a8ebf20-816a-4a65-b81f-aba8454a6534 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:15:54.757546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Attempting to bind port 8a8ebf20-816a-4a65-b81f-aba8454a6534 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:15:54.757917 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Attempting to bind port 8a8ebf20-816a-4a65-b81f-aba8454a6534 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:15:54.762830 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 15, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:15:54.763203 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:15:54.763624 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.764008 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:15:54.764466 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Bound port: 8a8ebf20-816a-4a65-b81f-aba8454a6534, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:15:54.764858 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.817504 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] For port 8a8ebf20-816a-4a65-b81f-aba8454a6534, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:15:54.820592 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] For port 8a8ebf20-816a-4a65-b81f-aba8454a6534, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=8a8ebf20-816a-4a65-b81f-aba8454a6534,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:15:54.876347 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:54.932068 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Routers {'b355dc75-0f49-49cf-a143-8c76df13fa05'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:15:54.932541 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:15:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['b355dc75-0f49-49cf-a143-8c76df13fa05'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:54.967978 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9eda4e-1eb1-450d-a47a-bf388f50e57c None None] Pushing event updated for resources: {'Port': ['ID=8a8ebf20-816a-4a65-b81f-aba8454a6534,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:55.003219 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56058) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:15:55.040640 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] Set router b355dc75-0f49-49cf-a143-8c76df13fa05 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:15:55.115495 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-445c7a79-eb07-43f6-937f-ddeb8772b4c4 admin admin] 10.222.0.10 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1111147 Nov 11 14:15:55.259937 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28'}], 'enable_snat': True}, 'gw_port_id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:51Z', 'revision_number': 4, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port': {'id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:2f:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:51Z', 'updated_at': '2021-11-11T14:15:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:46Z', 'revision_number': 5, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:15:55.287809 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7361476-613f-43b2-b138-a5b5d2bafa89 None None] The sync data for ids ['b355dc75-0f49-49cf-a143-8c76df13fa05'] in dv-cinder-777031-9-iscsi is: [{'id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'name': 'router1', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28'}], 'enable_snat': True}, 'gw_port_id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:15:33Z', 'updated_at': '2021-11-11T14:15:51Z', 'revision_number': 4, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'gw_port': {'id': '8a8ebf20-816a-4a65-b81f-aba8454a6534', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:2f:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:51Z', 'updated_at': '2021-11-11T14:15:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '4568758d-9c4a-4751-b9c3-748def0b86b6', 'name': '', 'network_id': '90af38f1-ccb9-47ec-b23d-bdc77879fa69', 'tenant_id': '15b8b2c081c84adf90f282a7f0b285df', 'mac_address': 'fa:16:3e:ae:98:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b355dc75-0f49-49cf-a143-8c76df13fa05', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:15:42Z', 'updated_at': '2021-11-11T14:15:46Z', 'revision_number': 5, 'project_id': '15b8b2c081c84adf90f282a7f0b285df', 'subnets': [{'id': '69c5cec9-092b-4f7f-8b90-d72e44c5bc34', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'e6b75648-02e7-4256-879f-c9d250ea9f9f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:15:55.542018 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 8a8ebf20-816a-4a65-b81f-aba8454a6534 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:15:55.599629 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 8a8ebf20-816a-4a65-b81f-aba8454a6534 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:55.599916 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:55.698095 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:55.723800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 8a8ebf20-816a-4a65-b81f-aba8454a6534, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=8a8ebf20-816a-4a65-b81f-aba8454a6534,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:15:55.797795 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:15:55.857155 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=8a8ebf20-816a-4a65-b81f-aba8454a6534,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:15:57.510773 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 8a8ebf20-816a-4a65-b81f-aba8454a6534 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:15:57.559674 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 8a8ebf20-816a-4a65-b81f-aba8454a6534 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:15:57.560102 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:01.359285 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:16:06.027016 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-73f02a0a-2f50-4ed0-8509-1b2a6b4a4fe6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:08.436298 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fd785939-6a3c-4c73-a4f4-0abf678ea869 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:09.556250 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:10.653232 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:11.693057 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:36.037454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7e13cf67-4f28-4e83-b2a6-e1ac40686e95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:38.359461 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:16:38.472295 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5da4b347-c8ba-457d-a665-eeaaef19d1f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:39.558441 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:40.648844 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:16:41.688873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:06.023918 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e403ab90-fca5-4eb6-bbba-ed6fd0da22d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:08.460465 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fcda1865-d4df-4a92-a779-b621583cf69c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:09.557145 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:10.654944 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:11.700262 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:15.359126 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:17:33.533167 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56620) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:33.592329 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.pecan_wsgi.hooks.translation [None req-7d545b52-1168-4d8f-b8f7-04324a08fff2 admin admin] GET failed (client error): The resource could not be found. Nov 11 14:17:33.593629 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7d545b52-1168-4d8f-b8f7-04324a08fff2 admin admin] 10.222.0.10 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0595374 Nov 11 14:17:33.754923 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-319d4245-aaf9-4a2f-bdd2-5a85bd6c6cdc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:33.756305 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-319d4245-aaf9-4a2f-bdd2-5a85bd6c6cdc admin admin] 10.222.0.10 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1576645 Nov 11 14:17:36.018228 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6daed83c-9fc8-46e7-a9fa-835c777b942f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:36.053632 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56630) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:36.145804 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-439b1b01-6adc-4cd3-a5e7-a1291c5f9722 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:36.147125 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-439b1b01-6adc-4cd3-a5e7-a1291c5f9722 admin admin] 10.222.0.10 "GET /v2.0/subnets/69c5cec9-092b-4f7f-8b90-d72e44c5bc34 HTTP/1.1" status: 200 len: 849 time: 0.0924771 Nov 11 14:17:36.157264 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:17:36.242498 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:36.435160 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8764490977666'] for subnet, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:36.468360 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:36.468943 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:36.473012 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] 10.222.0.10 "PUT /v2.0/subnets/69c5cec9-092b-4f7f-8b90-d72e44c5bc34 HTTP/1.1" status: 200 len: 868 time: 0.3179014 Nov 11 14:17:36.473149 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3b23a33-05af-4e24-90e0-bcf981c56559 None None] Network 90af38f1-ccb9-47ec-b23d-bdc77879fa69 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:17:36.493749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=69c5cec9-092b-4f7f-8b90-d72e44c5bc34,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:17:36.502336 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.502725 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.503035 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.503382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.503715 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.504056 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.504384 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.504716 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.505036 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.505350 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.505662 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.505973 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad478c9d-edde-4f47-a9a7-7bea0b7d3ed2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:17:36.855139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-1d9af60b-1d69-4fff-a32d-101c50cef868 None None] Provisioning complete for port c6f605b6-3f0f-40a5-92c7-145cf4a24e22 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:17:36.855548 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1d9af60b-1d69-4fff-a32d-101c50cef868 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:36.939973 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-1d9af60b-1d69-4fff-a32d-101c50cef868 None None] Provisioning complete for port 4568758d-9c4a-4751-b9c3-748def0b86b6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:17:36.940338 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1d9af60b-1d69-4fff-a32d-101c50cef868 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:38.460142 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-58a132fe-5250-4ff9-a4a2-cbef1b84f4d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:38.806909 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56638) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:39.074323 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8c67030-7c11-48df-8dac-a2c5e9ff873a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:39.074691 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8c67030-7c11-48df-8dac-a2c5e9ff873a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:39.076234 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-a8c67030-7c11-48df-8dac-a2c5e9ff873a admin admin] 10.222.0.10 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2682869 Nov 11 14:17:39.549385 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:40.671452 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:41.341680 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56646) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:41.471618 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcd29558-f420-40c8-bd35-04549cee6d47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:41.472079 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcd29558-f420-40c8-bd35-04549cee6d47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:41.473585 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-fcd29558-f420-40c8-bd35-04549cee6d47 admin admin] 10.222.0.10 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1309721 Nov 11 14:17:41.734513 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:17:43.742759 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56654) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:43.863772 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a2347a9-11ef-4839-97af-b6639ee59514 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:43.865165 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8a2347a9-11ef-4839-97af-b6639ee59514 admin admin] 10.222.0.10 "GET /v2.0/networks/2695a271-995b-4caa-b664-bb0645c2bc02 HTTP/1.1" status: 200 len: 886 time: 0.1214254 Nov 11 14:17:46.148480 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56662) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:46.293160 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b16dd51c-56fe-49a0-bfe0-1098455d32e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:46.294496 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b16dd51c-56fe-49a0-bfe0-1098455d32e4 admin admin] 10.222.0.10 "GET /v2.0/networks/90af38f1-ccb9-47ec-b23d-bdc77879fa69 HTTP/1.1" status: 200 len: 869 time: 0.1450174 Nov 11 14:17:48.603390 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56672) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:48.728275 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eabaf25c-426e-489f-b1f4-0240a04735cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:48.728727 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eabaf25c-426e-489f-b1f4-0240a04735cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:48.730262 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-eabaf25c-426e-489f-b1f4-0240a04735cb admin admin] 10.222.0.10 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1259363 Nov 11 14:17:51.078089 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56680) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:51.232624 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e93268-1c2a-458d-967c-7613b321791c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:51.235455 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e93268-1c2a-458d-967c-7613b321791c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:51.235455 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d9e93268-1c2a-458d-967c-7613b321791c admin admin] 10.222.0.10 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1547568 Nov 11 14:17:52.357511 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:17:53.527611 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56688) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:53.620869 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d24106a-8913-4907-844a-16c84aeaf74b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:53.622186 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7d24106a-8913-4907-844a-16c84aeaf74b admin admin] 10.222.0.10 "GET /v2.0/subnets/69c5cec9-092b-4f7f-8b90-d72e44c5bc34 HTTP/1.1" status: 200 len: 868 time: 0.0933597 Nov 11 14:17:55.961462 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56696) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:17:56.046124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14b49084-055f-4589-b96d-240e9bc8ea95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:17:56.047957 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-14b49084-055f-4589-b96d-240e9bc8ea95 admin admin] 10.222.0.10 "GET /v2.0/subnets/872490fe-8b51-42ad-a4a2-14f82622d8e6 HTTP/1.1" status: 200 len: 816 time: 0.0849476 Nov 11 14:18:06.037273 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-abfaa64c-e0d8-4572-982e-a35d23e55cb6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:08.434829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-dc7ca181-b11d-4f84-8dd8-767ec1a3d10d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:09.560481 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:10.682621 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:11.682873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:21.398590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56750) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:18:21.445725 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [None req-7ed08481-557f-4160-86a7-086f96684151 admin admin] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:18:21.446703 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7ed08481-557f-4160-86a7-086f96684151 admin admin] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0471992 Nov 11 14:18:23.836143 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56758) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:18:23.898910 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6b305a0-2363-4e5a-ad87-b1291cf18734 admin admin] GET failed (client error): The resource could not be found. Nov 11 14:18:23.900406 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c6b305a0-2363-4e5a-ad87-b1291cf18734 admin admin] 10.222.0.10 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0632389 Nov 11 14:18:23.990026 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d27a1981-3342-45be-bb79-588b0fe4af6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:18:23.991711 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d27a1981-3342-45be-bb79-588b0fe4af6f admin admin] 10.222.0.10 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0863321 Nov 11 14:18:26.298165 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56766) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:18:26.346175 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:18:26.425728 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Made reservation on behalf of 942a10d16bdc48d1b94f6764e5c615c8 for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:18:26.428020 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:26.455504 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING neutron.services.revisions.revision_plugin [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Could not find related network for resource to bump revision. Nov 11 14:18:26.472271 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 302} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:18:26.484263 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8764490884316', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:26.485356 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Unsubscribe: segment precommit_create {{(pid=102268) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 11 14:18:26.485819 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Added segment e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6 of type vlan for network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 Nov 11 14:18:26.532734 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:26.619986 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:26.620939 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:18:26.621532 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:26.720507 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] Pushing event updated for resources: {'Network': ['ID=7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:18:26.732090 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:18:26.742744 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bf0e4de9-f884-438e-8dc4-1bac402fdea4 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4434426 Nov 11 14:18:29.105852 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56774) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:18:29.168367 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d85d918-d45c-4510-b996-4e9d3777a2ab admin admin] GET failed (client error): The resource could not be found. Nov 11 14:18:29.169655 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1d85d918-d45c-4510-b996-4e9d3777a2ab admin admin] 10.222.0.10 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0628233 Nov 11 14:18:29.242175 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e253ef19-7098-420c-ab73-8a29456fbde3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:18:29.243626 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e253ef19-7098-420c-ab73-8a29456fbde3 admin admin] 10.222.0.10 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0686750 Nov 11 14:18:29.254037 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Request body: {'subnet': {'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3', 'name': 'shared-subnet', 'description': 'shared-subnet', 'ip_version': 4, 'cidr': '192.168.233.0/24'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:18:29.356526 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:18:29.362961 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Made reservation on behalf of 942a10d16bdc48d1b94f6764e5c615c8 for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:18:29.365264 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Publish callbacks [] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:29.580403 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:29.627483 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Pushing event updated for resources: {'Subnet': ['ID=c8956072-efe3-4b30-a856-f2815b650289,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:18:29.643500 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Checking segment: {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:18:29.643854 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Network hostable DHCP agents. Network: 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:18:29.731644 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:18:29.823819 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:18:29.827807 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:18:29.828889 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:29.833154 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-756787f8-f956-45fe-a6f0-65bdc0b33696 None None] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:18:29.908891 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-39e40ee6-07b9-4e00-904f-086073bca9ce admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6580465 Nov 11 14:18:29.980492 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3', 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3', 'tenant_id': '942a10d16bdc48d1b94f6764e5c615c8', 'fixed_ips': [{'subnet_id': 'c8956072-efe3-4b30-a856-f2815b650289'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:18:29.981871 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.220539 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Allocated IP 192.168.233.2 (7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3/c8956072-efe3-4b30-a856-f2815b650289/dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:18:30.363074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.431672 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.477685 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:18:30.478660 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Pushing event updated for resources: {'Port': ['ID=dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:18:30.481985 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:18:30.486654 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:18:30.490427 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.490789 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.491130 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.491491 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.491818 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.492142 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.492464 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.492783 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.493117 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.493441 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.493760 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.494073 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:18:30.550663 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Attempting to bind port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:18:30.551105 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Attempting to bind port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:18:30.551563 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Attempting to bind port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 on network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:18:30.557437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 18, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:18:30.557808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Checking segment: {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:18:30.558199 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.558582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Bound using segment: {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:18:30.559032 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Bound port: dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:18:30.559446 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.620747 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] For port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:18:30.623856 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] For port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:18:30.721310 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:30.782927 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7223113a-d9db-45fb-8f36-cafaba7bdd77 None None] Pushing event updated for resources: {'Port': ['ID=dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:18:31.602226 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1873663-c2c1-4ad6-8596-b3ace27cfa35 None None] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:18:31.664913 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:18:31.689187 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] Provisioning complete for port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:18:31.689560 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:31.838317 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:18:31.838657 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:31.901547 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:31.952038 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] For port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:18:31.989515 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:31.998760 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:32.083573 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4647bcc-252b-4581-960e-3b2e5f95f67c None None] Pushing event updated for resources: {'Port': ['ID=dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:18:32.089999 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.db.api [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102269) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 11 14:18:32.090317 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG oslo_db.api [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 11 14:18:32.122139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-23016ba7-c13f-4a78-ba18-73ef107a3c00 None None] Provisioning complete for port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:18:32.122339 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-23016ba7-c13f-4a78-ba18-73ef107a3c00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:33.590640 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:18:33.649262 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port dfa36f86-f2c7-4cf4-9de3-7a3abfab9ed9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:18:33.649622 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:36.034839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-480a4d19-5dc2-48b1-8499-1561a69c736b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:38.437006 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-870d6d2b-1b30-488a-a603-da13db5bfcb3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:39.554450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:40.659829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:18:41.685988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:06.025863 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c02d1ba2-11a5-473e-90ea-14dc6422ce7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:06.356822 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:19:08.443048 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6fcd1d3f-907b-4867-a206-38189b1ead2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:09.565722 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:10.654317 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:11.686759 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:36.034270 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fed37c9e-0893-4661-a931-31307ef90a7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:38.454372 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b50cd3e5-5bde-4650-a3d9-dcb6fb1a6855 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:39.605440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:40.680167 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:41.783001 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:19:43.355574 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:20:06.020056 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-60ebd36e-8d76-434c-b1e7-5c7ca7820ea1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:07.938146 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56820) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:20:07.943863 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [None req-b0c34f86-42d9-461e-9857-6ed3c89cc6c5 tempest-verify_tempest_config-1339672320 tempest-verify_tempest_config-1339672320-project] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:20:07.944836 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b0c34f86-42d9-461e-9857-6ed3c89cc6c5 tempest-verify_tempest_config-1339672320 tempest-verify_tempest_config-1339672320-project] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0057216 Nov 11 14:20:08.436739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 56838) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:20:08.460221 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2b5c3919-6039-4343-99be-7ef0573180ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.535859 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.635109 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.697467 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.739976 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b62ef85-2f3f-44ab-937b-a5c10a7db266,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:20:08.744489 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=e8dc2b11681e481482bb9361edcac505&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3066919 Nov 11 14:20:08.747490 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56842) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.756381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b37b6e-b69e-4c9e-baba-17a0a624e755 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:08.800913 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.820598 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.988339 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.990966 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:08.992145 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/9b62ef85-2f3f-44ab-937b-a5c10a7db266 HTTP/1.1" status: 204 len: 168 time: 0.2437372 Nov 11 14:20:09.000474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b62ef85-2f3f-44ab-937b-a5c10a7db266,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:20:09.007132 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.009800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.010571 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.010571 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.010865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91b44828-ebe3-423e-8d84-a7a6ea7ce5f9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:20:09.563162 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:10.680077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:11.680063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:20.354883 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:20:36.016444 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a4441b2d-c58f-493b-9aba-5db4c3d5968d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:38.467935 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-f327b23f-c9cb-42b3-a7f1-65a1e64ed37f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:39.574319 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:40.668132 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:41.716853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:20:57.355788 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:21:06.033716 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2d338898-fe5f-4a7e-b623-693daef1e83c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:08.436829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2451b8f2-d02b-4bf1-b5a6-e2ec72a6e578 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:09.576956 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:10.685096 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:11.685132 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:34.355077 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 5 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:21:36.020303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a4b70697-2c88-4090-bf35-0bc3ea2a72a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:38.427963 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7d3b9aed-3b92-49d4-8c43-b7373cb76a92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:39.593678 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:40.677285 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:41.700110 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:42.042818 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-394839'] for agent, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:21:57.511551 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56920) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:21:57.613170 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ab13d45a-ab7a-4649-84bd-d5b6be8344e6 admin admin] 10.222.0.10 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1005189 Nov 11 14:21:59.925329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 56930) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:21:59.979711 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-92a5adb1-e629-4071-8ffc-c225de2ac248 admin admin] 10.222.0.10 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0532970 Nov 11 14:22:06.016715 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8d83cb5-ff6d-405e-8f86-73e209ffb0c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:08.450302 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-9c6080b2-cdeb-46f6-9a4e-4d1acdbcdb96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:09.574340 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:10.673261 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:11.353909 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:22:11.679026 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:11.964892 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:36.010262 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d87f30b0-324c-4f0c-81ca-ffd054d04f8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:38.433043 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fdce7f2c-3b82-4c82-950f-bbf1a5f9be80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:39.593076 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:40.713247 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:41.673031 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:41.959044 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:22:48.354000 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:23:06.010631 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b8e4fc6e-4752-4973-93fb-78590a61d858 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:08.448880 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d938362a-6e17-4b5f-a8bf-85c8972f84a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:09.588732 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:10.695960 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:11.677690 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:11.993001 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:25.353685 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:23:30.745314 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57074) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:31.197141 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-network', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:31.294540 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Made reservation on behalf of 81dcff4bc9f54a4dacd1740ab810742f for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:31.296990 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.307167 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.386598 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.467652 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.492212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 346} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:23:31.504771 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b32fc76-1541-4148-b387-a4fcf019d3db,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:31.513663 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.514080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.514481 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.514876 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.515268 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.515728 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.516117 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.516520 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.516907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.517288 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.517710 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.518056 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Tracked resource versions report: Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: pushed versions: Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: { 'AddressGroup': {'1.2'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'ConntrackHelper': {'1.0'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Log': {'1.0'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Network': {'1.1'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Port': {'1.7'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'PortForwarding': {'1.2'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'QosPolicy': {'1.10'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroup': {'1.5'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SubPort': {'1.0'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Subnet': {'1.1'}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Trunk': {'1.1'}} Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: consumer versions: Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: HyperV agent@hv-cinder-77703: {}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'ConntrackHelper': '1.0', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Log': '1.0', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Network': '1.1', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Port': '1.7', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'PortForwarding': '1.2', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'QosPolicy': '1.10', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroup': '1.5', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SecurityGroupRule': '1.2', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'SubPort': '1.0', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Subnet': '1.1', Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: 'Trunk': '1.1'}} Nov 11 14:23:31.519865 dv-cinder-777031-9-iscsi neutron-server[102267]: {{(pid=102267) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:23:31.526450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.528207 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Added segment 6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20 of type vlan for network bc415290-2d4a-450f-b1bb-bf8153b56614 Nov 11 14:23:31.569822 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.679004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.680027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:31.680650 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:31.738683 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] Pushing event updated for resources: {'Network': ['ID=bc415290-2d4a-450f-b1bb-bf8153b56614,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:31.749270 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network bc415290-2d4a-450f-b1bb-bf8153b56614 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:23:31.789648 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-5f2c1d73-94f3-475b-a511-327c8c3c3f2f admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.0432110 Nov 11 14:23:31.795694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57120) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:31.801055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Request body: {'subnet': {'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-subnet', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:31.890498 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Made reservation on behalf of 81dcff4bc9f54a4dacd1740ab810742f for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:31.893125 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.158044 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.211143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9d424b9f-e0e9-479a-ab04-c4aa25cf128d,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:32.226402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Checking segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:32.226759 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Network hostable DHCP agents. Network: bc415290-2d4a-450f-b1bb-bf8153b56614, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:23:32.300463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Network bc415290-2d4a-450f-b1bb-bf8153b56614 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:23:32.525147 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, bc415290-2d4a-450f-b1bb-bf8153b56614) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:32.530174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:32.535924 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.536717 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98d2b88e-e6f2-4cfc-af5f-a98fc6481b2e None None] Network bc415290-2d4a-450f-b1bb-bf8153b56614 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:23:32.615237 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-474110be-a6bb-47c1-b4db-0e9cfb899498 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.8177350 Nov 11 14:23:32.622402 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57154) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:32.629603 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:32.681760 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-690d8365-dea3-4eb8-8965-15e6c8b3b321 None None] Network bc415290-2d4a-450f-b1bb-bf8153b56614 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:23:32.736644 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.738501 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.819975 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:32.876606 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57166) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:33.041521 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.236742 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1727612514-network', 'tenant_id': 'bdc0ecb12a544f42ac73824cb88fff50'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:33.446203 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.465607 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.519286 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Made reservation on behalf of bdc0ecb12a544f42ac73824cb88fff50 for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:33.521663 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.537831 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.664143 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.694956 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Allocated IP 172.27.1.101 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/b9e6fea4-f547-4d47-9255-9473815a73ca) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:23:33.854231 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.876185 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.888236 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 332} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:23:33.913247 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:33.913594 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Added segment 1f5a608b-b556-45dc-b01f-3b9432671af9 of type vlan for network c5b58dcb-77a0-4901-9126-308811d4244f Nov 11 14:23:33.924668 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2825989-7d0d-4b94-8503-d93685f9337d,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:33.950345 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.950957 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.954458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.955336 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.959913 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.960305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.960670 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.961034 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.961415 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.961719 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.963210 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.965320 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Tracked resource versions report: Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: pushed versions: Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: { 'AddressGroup': {'1.2'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'ConntrackHelper': {'1.0'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Log': {'1.0'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Network': {'1.1'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Port': {'1.7'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'PortForwarding': {'1.2'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'QosPolicy': {'1.10'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroup': {'1.5'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SubPort': {'1.0'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Subnet': {'1.1'}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Trunk': {'1.1'}} Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: consumer versions: Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: HyperV agent@hv-cinder-77703: {}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'ConntrackHelper': '1.0', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Log': '1.0', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Network': '1.1', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Port': '1.7', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'PortForwarding': '1.2', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'QosPolicy': '1.10', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroup': '1.5', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SecurityGroupRule': '1.2', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'SubPort': '1.0', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Subnet': '1.1', Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: 'Trunk': '1.1'}} Nov 11 14:23:33.967756 dv-cinder-777031-9-iscsi neutron-server[102268]: {{(pid=102268) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:23:34.038477 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.125217 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.153009 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:34.159064 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.159064 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:34.159064 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.160609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:34.193925 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:23:34.376044 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Pushing event updated for resources: {'Port': ['ID=b9e6fea4-f547-4d47-9255-9473815a73ca,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:34.384701 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.5070915 Nov 11 14:23:34.387735 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57240) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:34.395398 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Request body: {'subnet': {'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1727612514-subnet', 'tenant_id': 'bdc0ecb12a544f42ac73824cb88fff50', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:34.400032 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3474c4-4983-4899-8d8e-41e14fde36e3 admin admin] Pushing event updated for resources: {'Network': ['ID=c5b58dcb-77a0-4901-9126-308811d4244f,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:34.412116 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network c5b58dcb-77a0-4901-9126-308811d4244f details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:23:34.523604 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Made reservation on behalf of bdc0ecb12a544f42ac73824cb88fff50 for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:34.527157 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Publish callbacks [] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.633873 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.758155 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.813896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=f61b21b8-9633-4547-a15b-20ec2c3f175f,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:34.822530 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Checking segment: {'id': '1f5a608b-b556-45dc-b01f-3b9432671af9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:34.822886 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Network hostable DHCP agents. Network: c5b58dcb-77a0-4901-9126-308811d4244f, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:23:34.840544 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:34.913469 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Network c5b58dcb-77a0-4901-9126-308811d4244f is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:23:34.994298 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, c5b58dcb-77a0-4901-9126-308811d4244f) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:35.004651 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:35.005255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:35.005994 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03ebd39d-80b4-47cd-9d18-148c964fb63f None None] Network c5b58dcb-77a0-4901-9126-308811d4244f requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:23:35.073411 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:23:35.120893 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-77f69053-a4d8-46a2-a3e1-cd81524746cf admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7312920 Nov 11 14:23:35.171401 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67d46151-c065-42d1-9073-0c9c39216f9c None None] Network c5b58dcb-77a0-4901-9126-308811d4244f requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:23:35.219783 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:23:35.230921 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Sync routers for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:23:35.244504 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:23:35.245170 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:23:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:35.308159 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:35.309614 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c110063e-12a9-4436-84ed-aea4c33a8f4b admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 2.6856356 Nov 11 14:23:35.312846 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57264) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:35.479157 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:23:35.725296 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:34Z', 'revision_number': 3, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:35.752834 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Checking router: 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:23:35.753187 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Updating router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 port b9e6fea4-f547-4d47-9255-9473815a73ca binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:23:35.772777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57300) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:35.776075 dv-cinder-777031-9-iscsi neutron-server[102267]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 11 14:23:35.777694 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:35.967291 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-734af027-e5a1-43cf-83f5-c849281f9bae tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:35.967291 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-734af027-e5a1-43cf-83f5-c849281f9bae tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/networks?id=c5b58dcb-77a0-4901-9126-308811d4244f HTTP/1.1" status: 200 len: 812 time: 0.1896288 Nov 11 14:23:35.983001 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-45530484-467a-4dd7-b164-957a8d86dca8 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/quotas/bdc0ecb12a544f42ac73824cb88fff50 HTTP/1.1" status: 200 len: 375 time: 0.0114810 Nov 11 14:23:35.984303 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.042378 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-23d19bd7-89bf-42ed-9bb1-55156512974e tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=bdc0ecb12a544f42ac73824cb88fff50&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0514014 Nov 11 14:23:36.058466 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.079413 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d578e4f1-2900-4f6c-997d-a58d8c36a5e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.130719 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.174770 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Allocated IP 172.20.0.1 (bc415290-2d4a-450f-b1bb-bf8153b56614/9d424b9f-e0e9-479a-ab04-c4aa25cf128d/967def6c-cba2-47e2-9ab6-b715ae46915d) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:23:36.183144 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Pushing event updated for resources: {'Port': ['ID=b9e6fea4-f547-4d47-9255-9473815a73ca,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:36.201107 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.201490 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.202019 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.202267 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.202606 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.202938 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.203267 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.203859 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.204206 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.204539 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.204864 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.205183 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Tracked resource versions report: Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: pushed versions: Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: { 'AddressGroup': {'1.2'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'ConntrackHelper': {'1.0'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Log': {'1.0'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Network': {'1.1'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Port': {'1.7'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'PortForwarding': {'1.2'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'QosPolicy': {'1.10'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroup': {'1.5'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SubPort': {'1.0'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Subnet': {'1.1'}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Trunk': {'1.1'}} Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: consumer versions: Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: HyperV agent@hv-cinder-77703: {}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'ConntrackHelper': '1.0', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Log': '1.0', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Network': '1.1', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Port': '1.7', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'PortForwarding': '1.2', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'QosPolicy': '1.10', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroup': '1.5', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SecurityGroupRule': '1.2', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'SubPort': '1.0', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Subnet': '1.1', Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: 'Trunk': '1.1'}} Nov 11 14:23:36.207081 dv-cinder-777031-9-iscsi neutron-server[102270]: {{(pid=102270) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:23:36.216336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Attempting to bind port b9e6fea4-f547-4d47-9255-9473815a73ca on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:23:36.216792 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Attempting to bind port b9e6fea4-f547-4d47-9255-9473815a73ca by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:23:36.217358 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Attempting to bind port b9e6fea4-f547-4d47-9255-9473815a73ca on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:36.226832 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 23, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:23:36.231336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:36.231336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.231336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:23:36.231336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Bound port: b9e6fea4-f547-4d47-9255-9473815a73ca, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:23:36.231336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.279322 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9382e18c-d096-46d3-93ed-b05b640e0d81 service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:23:36.280335 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9382e18c-d096-46d3-93ed-b05b640e0d81 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0844495 Nov 11 14:23:36.289183 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] For port b9e6fea4-f547-4d47-9255-9473815a73ca, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:23:36.292744 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] For port b9e6fea4-f547-4d47-9255-9473815a73ca, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b9e6fea4-f547-4d47-9255-9473815a73ca,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:23:36.312795 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.370909 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.394660 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-b6361893-f668-4a2a-b380-88e349c785ad service neutron] 10.222.0.10 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1067750 Nov 11 14:23:36.462509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.466296 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6855e9-e22d-43ec-ad39-888a96263311 None None] Pushing event updated for resources: {'Port': ['ID=b9e6fea4-f547-4d47-9255-9473815a73ca,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:36.472631 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:23:36.472631 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:23:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:36.500449 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-0124eaa3-4df4-457d-a57c-17db3085cb89 service neutron] 10.222.0.10 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1048315 Nov 11 14:23:36.510650 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Pushing event updated for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:36.522463 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Network bc415290-2d4a-450f-b1bb-bf8153b56614 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:36.523864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:36.532572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:23:36.532572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.590497 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:23:36.849269 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:36.873995 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:34Z', 'revision_number': 3, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:36.911354 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60d48e30-9e89-4696-9b43-1c6274849713 None None] The sync data for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi is: [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:34Z', 'revision_number': 3, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:23:37.073124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.168484 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.168484 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.245626 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c72e3cdc-304b-4712-b4e4-97813e97992d req-1f9c7273-db89-446b-863d-728b5750ef46 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0837278 Nov 11 14:23:37.414029 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Pushing event updated for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:37.462031 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Network bc415290-2d4a-450f-b1bb-bf8153b56614 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:37.463851 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:37.473063 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57378) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:37.693576 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:23:37.697003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f2634c9-a2fb-4adb-95fe-4a32069d7fb9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.804219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f2634c9-a2fb-4adb-95fe-4a32069d7fb9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.841860 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b9e6fea4-f547-4d47-9255-9473815a73ca up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:23:37.877056 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:23:37.891038 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f2634c9-a2fb-4adb-95fe-4a32069d7fb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:37.892947 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-693ce460-e724-4a45-9963-5124e0d1634b admin admin] 10.222.0.10 "PUT /v2.0/routers/16659e14-0fa0-4f58-8eaf-d4c08ef558c9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5789242 Nov 11 14:23:38.035440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b9e6fea4-f547-4d47-9255-9473815a73ca triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:23:38.035440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.037698 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2634c9-a2fb-4adb-95fe-4a32069d7fb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7b5fa13-1062-4bfa-81dd-a16bd5a252fc,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:38.129208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57422) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:38.131253 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0f2634c9-a2fb-4adb-95fe-4a32069d7fb9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=9da280f714cd457f92a7406a26ec5ee3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6516407 Nov 11 14:23:38.222054 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.269873 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.293729 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port b9e6fea4-f547-4d47-9255-9473815a73ca, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b9e6fea4-f547-4d47-9255-9473815a73ca,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:23:38.331420 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.388556 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.435735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57444) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:38.438191 dv-cinder-777031-9-iscsi neutron-server[102268]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 11 14:23:38.456478 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-76c02554-f596-4a2b-bbc7-f4bb19349176 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.491086 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=b9e6fea4-f547-4d47-9255-9473815a73ca,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:38.495403 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.500929 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.501520 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.502006 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.502516 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.503568 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.504054 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.504623 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.505137 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.505693 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.506217 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.507097 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.507732 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:23:38.509081 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.512750 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/d7b5fa13-1062-4bfa-81dd-a16bd5a252fc HTTP/1.1" status: 204 len: 168 time: 0.3785319 Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Tracked resource versions report: Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: pushed versions: Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: { 'AddressGroup': {'1.2'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'ConntrackHelper': {'1.0'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Log': {'1.0'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Network': {'1.1'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Port': {'1.7'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'PortForwarding': {'1.2'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'QosPolicy': {'1.10'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroup': {'1.5'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroupRule': {'1.2'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SubPort': {'1.0'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Subnet': {'1.1'}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Trunk': {'1.1'}} Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: consumer versions: Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: { DHCP agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: HyperV agent@hv-cinder-77703: {}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: L3 agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: Metadata agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: Metering agent@dv-cinder-777031-9-iscsi: {}, Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: Open vSwitch agent@dv-cinder-777031-9-iscsi: { 'AddressGroup': '1.2', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'ConntrackHelper': '1.0', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Log': '1.0', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Network': '1.1', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Port': '1.7', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'PortForwarding': '1.2', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'QosPolicy': '1.10', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroup': '1.5', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SecurityGroupRule': '1.2', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'SubPort': '1.0', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Subnet': '1.1', Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: 'Trunk': '1.1'}} Nov 11 14:23:38.513938 dv-cinder-777031-9-iscsi neutron-server[102269]: {{(pid=102269) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 11 14:23:38.548543 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-54a868c2-b836-4b04-afba-54384ff788bb req-f7b0ce5c-2a0e-4f38-9241-c376c292d826 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.1115251 Nov 11 14:23:38.556496 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29eb4aed-2de1-4537-8c4a-b564f3d18a35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7b5fa13-1062-4bfa-81dd-a16bd5a252fc,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:38.754428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57468) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:38.827902 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-f4c6cc2a-861d-4d86-80f7-f8e0cf863331 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:38.829366 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-f4c6cc2a-861d-4d86-80f7-f8e0cf863331 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 819 time: 0.1429195 Nov 11 14:23:38.845161 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-138b172a-c8b2-4b78-b9bb-3ce72ce84a4c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/quotas/81dcff4bc9f54a4dacd1740ab810742f HTTP/1.1" status: 200 len: 375 time: 0.0093029 Nov 11 14:23:38.909454 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd4b49ab-1aeb-48e4-94da-4f8d94d0b548 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:38.927607 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-91756e5d-a56a-4f8a-8744-582775ed768b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0707273 Nov 11 14:23:39.005599 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd4b49ab-1aeb-48e4-94da-4f8d94d0b548 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.029288 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-97226803-8c19-401c-8c2c-a847858a8fd5 service neutron] 10.222.0.10 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1054943 Nov 11 14:23:39.096254 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd4b49ab-1aeb-48e4-94da-4f8d94d0b548 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.155522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4b49ab-1aeb-48e4-94da-4f8d94d0b548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b73be409-5a9e-48cb-a9f5-212e665011b4,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:39.180127 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3c3710ea-d03b-4746-9f5d-711b51cdabf4 service neutron] 10.222.0.10 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1433878 Nov 11 14:23:39.220635 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bd4b49ab-1aeb-48e4-94da-4f8d94d0b548 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=ba10ee3a9bc7473d9a87fcacb971cbfd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4595213 Nov 11 14:23:39.220635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57484) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:39.280353 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.302430 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.404055 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Sync routers for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:23:39.417416 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:23:39.418051 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:23:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:39.439633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.443100 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.444842 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b73be409-5a9e-48cb-a9f5-212e665011b4 HTTP/1.1" status: 204 len: 168 time: 0.2259631 Nov 11 14:23:39.465196 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4e3bcd-fb8d-4723-ad60-089b5d55e6b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b73be409-5a9e-48cb-a9f5-212e665011b4,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:39.486013 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-47c349f5-fce5-49d8-8443-c684696fbdc9 req-ce744cf0-49da-4ec3-9f9e-f1cec0d66a3b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 210 time: 0.0575724 Nov 11 14:23:39.540381 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57510) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:39.556907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-398c4664-df09-41c0-aec5-f07d089937de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.623465 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:23:39.903322 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-398c4664-df09-41c0-aec5-f07d089937de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.921436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b9e6fea4-f547-4d47-9255-9473815a73ca up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:23:39.949247 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c232b421-577a-410e-871b-4c978208edc2 req-5e977b33-2819-4c99-a1fa-c35bdda54203 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0545616 Nov 11 14:23:39.951054 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57536) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:39.954895 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:39.984295 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-398c4664-df09-41c0-aec5-f07d089937de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.044201 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-398c4664-df09-41c0-aec5-f07d089937de admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=f7fac95f605d412380ec5e925bcfef5f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5026731 Nov 11 14:23:40.047004 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57542) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:40.086926 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-e97d21f4-c267-45c6-866e-0754ba4245d2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:40.088619 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-e97d21f4-c267-45c6-866e-0754ba4245d2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 819 time: 0.2285542 Nov 11 14:23:40.090125 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398c4664-df09-41c0-aec5-f07d089937de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c069e1f4-c78e-4d6c-bcfe-84e2ca269dc1,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:40.118449 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-c42be6ea-4c37-4a1a-81ac-8fc9654dcc28 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/quotas/81dcff4bc9f54a4dacd1740ab810742f HTTP/1.1" status: 200 len: 375 time: 0.0202687 Nov 11 14:23:40.126199 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.161965 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.166417 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b9e6fea4-f547-4d47-9255-9473815a73ca triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:23:40.166729 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.225077 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-e15289f6-11e1-4f7f-873f-82ba665c28e4 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0957110 Nov 11 14:23:40.314954 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dcafddce-284f-464b-b8c1-c7b21655bb70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.343205 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 4, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '967def6c-cba2-47e2-9ab6-b715ae46915d', 'name': '', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'mac_address': 'fa:16:3e:c9:0c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:36Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 2, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'subnets': [{'id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:40.358884 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.365960 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.367125 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/c069e1f4-c78e-4d6c-bcfe-84e2ca269dc1 HTTP/1.1" status: 204 len: 168 time: 0.3185573 Nov 11 14:23:40.389304 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Checking router: 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:23:40.389953 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Updating router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 port 967def6c-cba2-47e2-9ab6-b715ae46915d binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:23:40.411886 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df427dd-52de-40da-8fca-9b1a3085247d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c069e1f4-c78e-4d6c-bcfe-84e2ca269dc1,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:40.430599 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-23ff8a4a-5694-43d3-a6d2-dd76520ffb9a service neutron] 10.222.0.10 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2045732 Nov 11 14:23:40.478467 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.553508 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dcafddce-284f-464b-b8c1-c7b21655bb70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.564629 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-7f425d90-9a29-4808-bed1-8706dd9db3ca service neutron] 10.222.0.10 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329856 Nov 11 14:23:40.644487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dcafddce-284f-464b-b8c1-c7b21655bb70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.690078 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-dcafddce-284f-464b-b8c1-c7b21655bb70 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=58a46163ac92443493ffbdc0e5d31062&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7378025 Nov 11 14:23:40.690930 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcafddce-284f-464b-b8c1-c7b21655bb70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=378e769b-d8a9-4ac5-9006-06164e68b7d0,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:40.692950 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57570) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:40.752417 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.756777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.798687 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.837150 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.881474 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a41593e6-9f8c-414d-b907-8c69ecc829b7 req-17b3d603-a523-40a7-9816-cdedac3ca0f6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0281553 Nov 11 14:23:40.913675 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.982876 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.986434 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:40.987610 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/378e769b-d8a9-4ac5-9006-06164e68b7d0 HTTP/1.1" status: 204 len: 168 time: 0.2936239 Nov 11 14:23:41.000613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208b05f9-0b34-400a-bd95-322562945692 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=378e769b-d8a9-4ac5-9006-06164e68b7d0,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:41.016680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb50b15-420e-4388-ae53-0a30eeb78b05 None None] Pushing event updated for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:41.101771 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Attempting to bind port 967def6c-cba2-47e2-9ab6-b715ae46915d on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:23:41.103442 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Attempting to bind port 967def6c-cba2-47e2-9ab6-b715ae46915d by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:23:41.104677 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Attempting to bind port 967def6c-cba2-47e2-9ab6-b715ae46915d on network bc415290-2d4a-450f-b1bb-bf8153b56614 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:41.114958 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 23, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:23:41.115620 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Checking segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:41.116179 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:41.117543 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Bound using segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:23:41.118232 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Bound port: 967def6c-cba2-47e2-9ab6-b715ae46915d, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:23:41.119323 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:41.164739 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f1c30e23-74a3-4ea0-a8a7-1c7be2f0b710 req-0fd4c643-1fcc-495e-8c34-d70d3c9908a9 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0322244 Nov 11 14:23:41.193456 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] For port 967def6c-cba2-47e2-9ab6-b715ae46915d, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:23:41.196756 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] For port 967def6c-cba2-47e2-9ab6-b715ae46915d, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=967def6c-cba2-47e2-9ab6-b715ae46915d,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:23:41.268513 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:41.334312 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:23:41.336118 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:23:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:41.338575 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb50b15-420e-4388-ae53-0a30eeb78b05 None None] Pushing event updated for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:41.460863 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:23:41.816615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:41.816615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 4, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '967def6c-cba2-47e2-9ab6-b715ae46915d', 'name': '', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'mac_address': 'fa:16:3e:c9:0c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:36Z', 'updated_at': '2021-11-11T14:23:41Z', 'revision_number': 4, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'subnets': [{'id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:23:41.841341 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b55cdf1b-f144-40de-95ff-4d3ac1fbc9e6 None None] The sync data for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi is: [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:23:36Z', 'revision_number': 4, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '967def6c-cba2-47e2-9ab6-b715ae46915d', 'name': '', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'mac_address': 'fa:16:3e:c9:0c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:36Z', 'updated_at': '2021-11-11T14:23:41Z', 'revision_number': 4, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'subnets': [{'id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:23:41.999314 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccf367dd-afc3-412c-b40e-81bf93576b33 req-df7080d2-784b-45b5-9f29-cd97f7ffedd0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0256023 Nov 11 14:23:42.273153 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ac612243-f326-403f-8112-b9ea25f1dbe6 req-b737de06-f775-4671-bdd6-35fe60275415 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0315773 Nov 11 14:23:42.492988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:43.098219 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d8b88c38-f0de-423a-8c3f-e90556d36c8e req-c723c6dc-0079-49ca-a38a-68ae4c8a12b0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0249975 Nov 11 14:23:43.370432 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d80a1bfe-f6cd-468c-bd9f-a783682e1fd1 req-83cae7dd-08b2-4dfc-bfe9-30f9f04e2cac tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0302255 Nov 11 14:23:43.786371 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 967def6c-cba2-47e2-9ab6-b715ae46915d up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:23:43.845124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 967def6c-cba2-47e2-9ab6-b715ae46915d triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:23:43.845574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:43.921979 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:43.965215 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 967def6c-cba2-47e2-9ab6-b715ae46915d, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=967def6c-cba2-47e2-9ab6-b715ae46915d,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:23:44.012036 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57716) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:44.026157 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.077553 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:44.128359 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55187958-14df-4a7c-9c11-10262b0e78d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.219314 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f3442f45-ae4e-49ae-b0bd-6806d9b7f4a7 req-e897cef0-cef5-4b37-8d1d-ed8f0c95f946 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0292706 Nov 11 14:23:44.238615 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55187958-14df-4a7c-9c11-10262b0e78d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.319134 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55187958-14df-4a7c-9c11-10262b0e78d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.361095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55187958-14df-4a7c-9c11-10262b0e78d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c956e6c-3f5c-470d-b7e0-c5fef445152b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:44.366157 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-55187958-14df-4a7c-9c11-10262b0e78d4 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=9d9a95dea8a74e1b888e5ba3dc50304b&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3525951 Nov 11 14:23:44.368911 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57736) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:44.423117 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.444943 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.465979 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bde5ae22-1cfa-4ec7-8a48-3ad7a3d41a28 req-a41129e1-a503-4c66-9077-8f4c9ba0d3cf tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0265980 Nov 11 14:23:44.593537 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.596333 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:44.597985 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4c956e6c-3f5c-470d-b7e0-c5fef445152b HTTP/1.1" status: 204 len: 168 time: 0.2280138 Nov 11 14:23:44.605801 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fca809-4c90-4f79-8389-1b120eda34eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c956e6c-3f5c-470d-b7e0-c5fef445152b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:45.315788 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 57768) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:45.337482 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8bfd546c-a9d7-48b3-8681-8096e3a9e9c1 req-00b55caa-cc2e-4a42-b2f4-96ffcfd525af tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0329797 Nov 11 14:23:45.343082 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f340f6b1-002b-44d5-9028-eb9bc985f55b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.431027 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f340f6b1-002b-44d5-9028-eb9bc985f55b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.511838 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f340f6b1-002b-44d5-9028-eb9bc985f55b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.552258 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f340f6b1-002b-44d5-9028-eb9bc985f55b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98c7a6a4-de0c-4385-995c-cd310335bacb,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:45.558684 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f340f6b1-002b-44d5-9028-eb9bc985f55b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=fa331d8501724497b7eb4a66fefc67c7&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2413576 Nov 11 14:23:45.569508 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4f507db5-beb2-4d78-9159-750e1bd37b0c req-f8a9e7a0-5e26-4b70-b0b9-4f0ce9466607 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0332205 Nov 11 14:23:45.569986 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 57782) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:45.594382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.11', 49909) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:45.631235 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.657399 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.760051 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 967def6c-cba2-47e2-9ab6-b715ae46915d up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:23:45.793953 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.796695 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.799098 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/98c7a6a4-de0c-4385-995c-cd310335bacb HTTP/1.1" status: 204 len: 168 time: 0.2277551 Nov 11 14:23:45.820011 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 967def6c-cba2-47e2-9ab6-b715ae46915d triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:23:45.820538 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:45.822701 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df794c74-c4cd-4d41-b2fe-741c6c9070d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98c7a6a4-de0c-4385-995c-cd310335bacb,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:45.949068 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-31b26ba5-18e8-4e94-b516-91c2ac20b97b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:45.950735 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-31b26ba5-18e8-4e94-b516-91c2ac20b97b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 819 time: 0.3552451 Nov 11 14:23:46.012698 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Request body: {'port': {'device_id': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'admin_state_up': True, 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:46.275128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Made reservation on behalf of 81dcff4bc9f54a4dacd1740ab810742f for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:46.295037 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:46.519319 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.11', 49916) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:46.581584 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5e4924ab-8344-4f0b-9a54-0e486d94dc50 req-8c487f1d-e369-4a94-884b-3cd5586c1663 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.1438401 Nov 11 14:23:46.588107 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Allocated IP 172.20.0.10 (bc415290-2d4a-450f-b1bb-bf8153b56614/9d424b9f-e0e9-479a-ab04-c4aa25cf128d/d3c800de-17fd-4c53-9b7d-1fcce1047246) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:23:46.724616 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-11da7b71-b3cd-4297-8b03-d6a59d8d3b61 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:46.726699 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-11da7b71-b3cd-4297-8b03-d6a59d8d3b61 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.11 "GET /v2.0/networks?id=c5b58dcb-77a0-4901-9126-308811d4244f HTTP/1.1" status: 200 len: 812 time: 0.2001984 Nov 11 14:23:46.744395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Request body: {'port': {'device_id': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f', 'admin_state_up': True, 'tenant_id': 'bdc0ecb12a544f42ac73824cb88fff50'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:46.839442 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:46.996593 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:47.119438 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Network bc415290-2d4a-450f-b1bb-bf8153b56614 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:47.120261 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:47.164243 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:23:47.170605 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:47.171296 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:47.186773 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f1e313be-d94b-4a6f-b535-13e5a7053eb3 req-ed2582a0-6a06-4e61-97e2-f98e3b33d8b9 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0656221 Nov 11 14:23:47.199022 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Made reservation on behalf of bdc0ecb12a544f42ac73824cb88fff50 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:47.207029 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:47.236607 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Pushing event updated for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:47.250477 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.11', 49923) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:47.387160 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-3a881b34-bfe5-4914-a329-ae774ff0191d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3782330 Nov 11 14:23:47.427890 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-83e3aff0-2c19-459b-8efb-6c662af94777 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:23:47.428854 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-83e3aff0-2c19-459b-8efb-6c662af94777 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0122962 Nov 11 14:23:47.528622 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-09559eee-0425-4fa8-85de-765ac4793bff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:47.530271 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-09559eee-0425-4fa8-85de-765ac4793bff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 819 time: 0.2787883 Nov 11 14:23:47.613419 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Request body: {'port': {'device_id': '758079e1-6605-445d-8973-3e12079a3fa0', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'admin_state_up': True, 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:47.798154 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3dd905ac-8ee8-4794-abd2-e6d870422e60 req-223b3f11-646a-4d5a-8dac-a4c3e5e53874 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0614018 Nov 11 14:23:47.960278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Allocated IP 172.20.0.8 (c5b58dcb-77a0-4901-9126-308811d4244f/f61b21b8-9633-4547-a15b-20ec2c3f175f/801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:23:48.002496 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Made reservation on behalf of 81dcff4bc9f54a4dacd1740ab810742f for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:23:48.006962 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:48.419724 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Allocated IP 172.20.0.2 (bc415290-2d4a-450f-b1bb-bf8153b56614/9d424b9f-e0e9-479a-ab04-c4aa25cf128d/1676270a-314b-482b-a80f-f262b7204376) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:23:48.483969 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a69887f6-c5f0-4cb9-b8b6-463024d3ac06 req-9261652e-c994-4494-bd8f-d4cb67d46669 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.1059666 Nov 11 14:23:48.601270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:48.669926 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Request body: {'port': {'device_id': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:48.800748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:48.828642 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:48.888605 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:49.000366 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Pushing event updated for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:49.040905 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Network c5b58dcb-77a0-4901-9126-308811d4244f is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:49.054881 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:49.058974 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:23:49.070412 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:49.071494 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:49.099485 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-19afa663-ca54-4f15-bebc-a250d46b35af req-07cb12f2-d55f-42d4-b4b9-0fb0ffed572f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0571637 Nov 11 14:23:49.268753 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-d8df8cba-17f3-4ea1-81d3-3e01e5e309ab tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5292072 Nov 11 14:23:49.695075 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:49.761424 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Network bc415290-2d4a-450f-b1bb-bf8153b56614 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:23:49.790713 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:23:49.796565 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:23:49.803420 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:49.804171 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:49.833878 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Pushing event updated for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:49.955174 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-56ebef3c-a0ea-4504-948d-3ddbf380e001 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3468540 Nov 11 14:23:49.968095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d3c800de-17fd-4c53-9b7d-1fcce1047246 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:23:49.975764 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:49.995410 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Transition to ACTIVE for port object d3c800de-17fd-4c53-9b7d-1fcce1047246 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:23:50.067236 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:50.127058 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Pushing event updated for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:50.185750 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb751274-6d39-4deb-9fce-979f876ffb0a req-7bb81115-9f9e-4914-bfa0-6c5920888c98 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:50.190511 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fb751274-6d39-4deb-9fce-979f876ffb0a req-7bb81115-9f9e-4914-bfa0-6c5920888c98 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.1189628 Nov 11 14:23:50.315155 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Attempting to bind port d3c800de-17fd-4c53-9b7d-1fcce1047246 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:23:50.316284 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Attempting to bind port d3c800de-17fd-4c53-9b7d-1fcce1047246 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:23:50.317230 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Attempting to bind port d3c800de-17fd-4c53-9b7d-1fcce1047246 on network bc415290-2d4a-450f-b1bb-bf8153b56614 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:50.329011 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Port d3c800de-17fd-4c53-9b7d-1fcce1047246 on network bc415290-2d4a-450f-b1bb-bf8153b56614 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:23:50.329705 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Attempting to bind port d3c800de-17fd-4c53-9b7d-1fcce1047246 on network bc415290-2d4a-450f-b1bb-bf8153b56614 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:50.352390 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 23, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:23:50.352390 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Checking segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:50.352940 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Bound using segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:23:50.354664 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Bound port: d3c800de-17fd-4c53-9b7d-1fcce1047246, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:23:50.354664 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:50.468887 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fb751274-6d39-4deb-9fce-979f876ffb0a req-bf31716d-43e3-421a-9721-23e1dc354bba tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2712696 Nov 11 14:23:50.490799 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:23:50.510431 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:23:50.622437 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59118a8-8d6c-4fd8-9940-e29e6a50af42 req-1ebe411e-4bf4-49e1-8881-155a2ebedecf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:50.626628 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a59118a8-8d6c-4fd8-9940-e29e6a50af42 req-1ebe411e-4bf4-49e1-8881-155a2ebedecf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0699341 Nov 11 14:23:50.674651 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a59118a8-8d6c-4fd8-9940-e29e6a50af42 req-36211b3a-4e41-4756-a1b5-cb3dc2c406ca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440376 Nov 11 14:23:50.771220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:50.809506 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:50.809966 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:50.811443 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] 10.222.0.11 "PUT /v2.0/ports/d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 1094 time: 2.4624102 Nov 11 14:23:50.811910 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:23:50.912050 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8eabac-cdac-4e52-a753-527f1ff5365e service neutron] Pushing event updated for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:51.155775 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ac7a1be-0849-460e-b816-bf94f6e1a825" -d '{"events": [{"name": "network-changed", "server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:23:51.224112 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb6fe30b-d104-413a-880b-b9572e82651f x-openstack-request-id: req-eb6fe30b-d104-413a-880b-b9572e82651f {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:23:51.224112 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:23:51.224401 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-eb6fe30b-d104-413a-880b-b9572e82651f {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:23:51.224958 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246', 'status': 'completed', 'code': 200} Nov 11 14:23:51.657306 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c85aad1-2a4d-428e-be5f-d7a746860217 req-77473cd9-a8cf-4d30-b908-804f13ecb269 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:51.660834 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c85aad1-2a4d-428e-be5f-d7a746860217 req-77473cd9-a8cf-4d30-b908-804f13ecb269 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.0885494 Nov 11 14:23:51.728325 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c85aad1-2a4d-428e-be5f-d7a746860217 req-4c28d2ff-c163-410a-bcc8-42aa225bf207 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589924 Nov 11 14:23:51.851404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f17c939-2f5f-44f6-92ae-88bd8fe218d5 req-98062091-c3f6-4afc-8c3f-f6b8a848489d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:51.856419 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7f17c939-2f5f-44f6-92ae-88bd8fe218d5 req-98062091-c3f6-4afc-8c3f-f6b8a848489d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0637429 Nov 11 14:23:51.899575 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58076) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:51.909409 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7f17c939-2f5f-44f6-92ae-88bd8fe218d5 req-84912de3-8ad7-4c27-80fe-a90618306431 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499353 Nov 11 14:23:52.262384 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8df26078-80ec-439c-baae-59cf097f4552 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.279866 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58090) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:52.394077 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58096) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:52.406872 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8df26078-80ec-439c-baae-59cf097f4552 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.465635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-86fbcee5-f7a4-4098-af16-52a1cd15fa7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.479454 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8df26078-80ec-439c-baae-59cf097f4552 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.561312 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-8df26078-80ec-439c-baae-59cf097f4552 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=190f716f57ba4402a11bdc1ac4d534af&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6608739 Nov 11 14:23:52.562170 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58110) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:52.576928 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df26078-80ec-439c-baae-59cf097f4552 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0c9ea73-b37c-4719-8c21-a14709d655dc,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:52.603296 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-45c67248-9921-431e-abab-400ecab10f4c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.719168 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.778375 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.896873 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-86fbcee5-f7a4-4098-af16-52a1cd15fa7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.942899 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-45c67248-9921-431e-abab-400ecab10f4c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:52.980137 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468928ac-e66a-46cc-bede-ecdc928e285c req-87502e12-8815-455d-b19f-78c36e5e5c5a tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:52.980137 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-468928ac-e66a-46cc-bede-ecdc928e285c req-87502e12-8815-455d-b19f-78c36e5e5c5a tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.0848093 Nov 11 14:23:53.012152 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-86fbcee5-f7a4-4098-af16-52a1cd15fa7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.039202 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-45c67248-9921-431e-abab-400ecab10f4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.048845 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86fbcee5-f7a4-4098-af16-52a1cd15fa7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31d9d56e-b0e5-48e7-a26c-73ba461d7c57,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:53.054203 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.059021 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.065165 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/d0c9ea73-b37c-4719-8c21-a14709d655dc HTTP/1.1" status: 204 len: 168 time: 0.5012155 Nov 11 14:23:53.075719 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c142923-1403-4266-8d7e-502356d246f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0c9ea73-b37c-4719-8c21-a14709d655dc,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:53.164342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5167fd-29f6-4c8b-8457-9b2eac2f8384 req-c17d0ba0-9382-4c76-87fa-24549b2bd75d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:53.164342 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc5167fd-29f6-4c8b-8457-9b2eac2f8384 req-c17d0ba0-9382-4c76-87fa-24549b2bd75d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.1218774 Nov 11 14:23:53.165439 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-468928ac-e66a-46cc-bede-ecdc928e285c req-ab342f4e-c58f-4837-bd2b-81e1a9dcdaf9 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1411593 Nov 11 14:23:53.165439 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-45c67248-9921-431e-abab-400ecab10f4c admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c469868779ac4ba78e569283e13315a3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7348373 Nov 11 14:23:53.165439 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-86fbcee5-f7a4-4098-af16-52a1cd15fa7b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=2a439a03d5704924a81be31f154d7680&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8692527 Nov 11 14:23:53.168530 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58134) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:53.169931 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58136) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:53.176690 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c67248-9921-431e-abab-400ecab10f4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f010020-5fa8-460e-8e53-20b69ca82fc1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:53.240624 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc5167fd-29f6-4c8b-8457-9b2eac2f8384 req-401b7655-b541-49f0-8cd5-de00e132233b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1192338 Nov 11 14:23:53.288800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.321940 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.323719 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.372923 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.578688 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.582189 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.585855 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4f010020-5fa8-460e-8e53-20b69ca82fc1 HTTP/1.1" status: 204 len: 168 time: 0.4122534 Nov 11 14:23:53.604775 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1514c687-8d7b-40eb-b4fc-f192e70e255b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f010020-5fa8-460e-8e53-20b69ca82fc1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:53.638311 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.641587 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:53.642737 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/31d9d56e-b0e5-48e7-a26c-73ba461d7c57 HTTP/1.1" status: 204 len: 168 time: 0.4699380 Nov 11 14:23:53.655060 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a489526-14e9-4942-b0f3-9114d63de55d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31d9d56e-b0e5-48e7-a26c-73ba461d7c57,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:54.309756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62fa4a98-7c40-4df7-b288-6530805f08d0 req-db52c6a2-5d8f-40d8-9482-97d39180dd55 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:54.312698 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-62fa4a98-7c40-4df7-b288-6530805f08d0 req-db52c6a2-5d8f-40d8-9482-97d39180dd55 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.0920591 Nov 11 14:23:54.391922 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-62fa4a98-7c40-4df7-b288-6530805f08d0 req-e4f055fe-262a-4e3a-be68-3cd5aeeeef00 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725045 Nov 11 14:23:54.415711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5fd09a5-4e55-4ce0-8820-1344be445c1d req-0773aa59-46b2-46d7-a33a-100d337a816f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:54.418918 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c5fd09a5-4e55-4ce0-8820-1344be445c1d req-0773aa59-46b2-46d7-a33a-100d337a816f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0938003 Nov 11 14:23:54.476266 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c5fd09a5-4e55-4ce0-8820-1344be445c1d req-fcb68b80-a822-4731-95d3-7f5515e6264c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519719 Nov 11 14:23:54.716028 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58186) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:54.730426 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c31095f3-6d21-4e01-9f2b-f96f941c962b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:54.824505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c31095f3-6d21-4e01-9f2b-f96f941c962b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:54.996054 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58192) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:55.004102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-573f7860-9d94-426f-b3dd-93f872057ed9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.111694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-573f7860-9d94-426f-b3dd-93f872057ed9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.180920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c31095f3-6d21-4e01-9f2b-f96f941c962b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.223580 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-c31095f3-6d21-4e01-9f2b-f96f941c962b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=3322bce9ba6f4b39ae4a5340ef86fc88&name=default HTTP/1.1" status: 200 len: 2995 time: 0.5063744 Nov 11 14:23:55.225397 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c31095f3-6d21-4e01-9f2b-f96f941c962b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e5d8816-d28f-41fd-861c-a81e1a9d26c7,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:55.226897 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58196) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:55.240893 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-573f7860-9d94-426f-b3dd-93f872057ed9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.314188 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573f7860-9d94-426f-b3dd-93f872057ed9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5a0f425-0585-4ecd-a54e-56fb0fbd0014,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:55.316626 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.321244 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-573f7860-9d94-426f-b3dd-93f872057ed9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5ad3bdfff8c1454288192c2e1f0d63be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3374479 Nov 11 14:23:55.321934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58198) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:55.359877 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.387414 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.406594 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.578342 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.588781 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.588781 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/5e5d8816-d28f-41fd-861c-a81e1a9d26c7 HTTP/1.1" status: 204 len: 168 time: 0.3524199 Nov 11 14:23:55.623335 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186efea9-1a93-47dd-a3c6-9f37deea7cd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e5d8816-d28f-41fd-861c-a81e1a9d26c7,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:55.638422 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec80d45-47ff-42c6-8242-2391a2be39fc req-9912fde3-6866-4ca3-8f0f-a00824cc48e3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:55.640422 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eec80d45-47ff-42c6-8242-2391a2be39fc req-9912fde3-6866-4ca3-8f0f-a00824cc48e3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0689523 Nov 11 14:23:55.641914 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.645493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:55.647784 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b5a0f425-0585-4ecd-a54e-56fb0fbd0014 HTTP/1.1" status: 204 len: 168 time: 0.3247607 Nov 11 14:23:55.648461 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e6ee70-f8a9-41ad-b4a8-12cab261d001 req-ffeca8b1-3abe-46d7-9fc1-137beb357035 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:55.656931 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-75e6ee70-f8a9-41ad-b4a8-12cab261d001 req-ffeca8b1-3abe-46d7-9fc1-137beb357035 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.1482451 Nov 11 14:23:55.673349 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3e86d0-9f22-4781-9e12-34d487ee0916 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5a0f425-0585-4ecd-a54e-56fb0fbd0014,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:55.737850 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58222) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:55.752651 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eec80d45-47ff-42c6-8242-2391a2be39fc req-6e82343d-a69f-4eaf-8892-571e72df50a0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035903 Nov 11 14:23:55.787781 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-75e6ee70-f8a9-41ad-b4a8-12cab261d001 req-2c397b8c-f075-443d-920a-e25eb9438d55 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246581 Nov 11 14:23:56.363617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c390c500-2901-4542-8854-a7b00b15d249 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:56.505577 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c390c500-2901-4542-8854-a7b00b15d249 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:56.764610 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c390c500-2901-4542-8854-a7b00b15d249 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:56.851164 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c390c500-2901-4542-8854-a7b00b15d249 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=0b0fe04e1e8f46fd8abe7e5cde3b1e28&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1096578 Nov 11 14:23:56.851559 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58266) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:56.864335 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c390c500-2901-4542-8854-a7b00b15d249 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=053c000d-025d-4101-ad42-de7a1ae4a5a7,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:56.985575 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b5955e-ee8c-4086-bccf-795ffd8d7bd0 req-402b301c-b7f7-45a7-801f-0c8a00f390d0 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:57.008736 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de427ec-0955-477c-b347-642d9c4d10b9 req-cd4815f9-986a-4e4e-8ec4-f88ad1063675 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:57.009253 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-69b5955e-ee8c-4086-bccf-795ffd8d7bd0 req-402b301c-b7f7-45a7-801f-0c8a00f390d0 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.0897391 Nov 11 14:23:57.009432 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3de427ec-0955-477c-b347-642d9c4d10b9 req-cd4815f9-986a-4e4e-8ec4-f88ad1063675 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0994008 Nov 11 14:23:57.030978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:57.077830 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-69b5955e-ee8c-4086-bccf-795ffd8d7bd0 req-e3b6d7ad-acac-46c9-a376-62bba64c45de tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816090 Nov 11 14:23:57.092703 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:57.135749 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3de427ec-0955-477c-b347-642d9c4d10b9 req-4f1fb924-2368-4674-ad3b-d051699735cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283007 Nov 11 14:23:57.267673 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:57.270877 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:57.272100 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/053c000d-025d-4101-ad42-de7a1ae4a5a7 HTTP/1.1" status: 204 len: 168 time: 0.4195733 Nov 11 14:23:57.280344 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc98fe95-fbf0-41cc-a995-c77f31ffafef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=053c000d-025d-4101-ad42-de7a1ae4a5a7,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:58.239120 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d7865e-0e90-444a-9abe-e971d43a0b1c req-986ddcb1-2d35-46f3-9078-119596c1bec5 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:58.248850 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-51d7865e-0e90-444a-9abe-e971d43a0b1c req-986ddcb1-2d35-46f3-9078-119596c1bec5 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 931 time: 0.0806327 Nov 11 14:23:58.319133 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-51d7865e-0e90-444a-9abe-e971d43a0b1c req-5731489e-8fe0-4233-b3e3-8ed9fdd4adad tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691731 Nov 11 14:23:58.346335 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74e9519-869e-41ac-9639-b3c8edeeec5a req-cd27b75a-69c8-4d47-9de7-de6c4bc8f382 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:58.346335 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c74e9519-869e-41ac-9639-b3c8edeeec5a req-cd27b75a-69c8-4d47-9de7-de6c4bc8f382 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0767398 Nov 11 14:23:58.421994 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c74e9519-869e-41ac-9639-b3c8edeeec5a req-0f801663-f04c-40c8-9a8f-a74a1b199739 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698900 Nov 11 14:23:58.590056 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Request body: {'port': {'device_id': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:58.590581 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Request body: {'port': {'device_id': '758079e1-6605-445d-8973-3e12079a3fa0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:23:58.743188 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:58.757768 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:58.771674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-e68c15ea-c5bd-4b59-9c8d-c8ebb38d7c63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:58.774882 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-e68c15ea-c5bd-4b59-9c8d-c8ebb38d7c63 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1097 time: 0.1414249 Nov 11 14:23:59.079054 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-7be28ae1-ed22-4c79-9e3e-21be19405305 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.080570 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-7be28ae1-ed22-4c79-9e3e-21be19405305 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2754767 Nov 11 14:23:59.147716 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:23:59.158410 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.193332 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Transition to ACTIVE for port object 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:23:59.302443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.459888 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Pushing event updated for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:59.475490 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Attempting to bind port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:23:59.475862 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Attempting to bind port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '1f5a608b-b556-45dc-b01f-3b9432671af9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:23:59.476195 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Attempting to bind port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 on network c5b58dcb-77a0-4901-9126-308811d4244f {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:59.482871 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 on network c5b58dcb-77a0-4901-9126-308811d4244f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:23:59.483778 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Attempting to bind port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 on network c5b58dcb-77a0-4901-9126-308811d4244f {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:23:59.489220 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 23, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:23:59.489576 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Checking segment: {'id': '1f5a608b-b556-45dc-b01f-3b9432671af9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:23:59.490126 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Bound using segment: {'id': '1f5a608b-b556-45dc-b01f-3b9432671af9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:23:59.490574 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Bound port: 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1f5a608b-b556-45dc-b01f-3b9432671af9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:23:59.490934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.507485 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-5b97befd-5fb1-4a1d-93f4-d7571f59583d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.509596 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8ac7a1be-0849-460e-b816-bf94f6e1a825 req-5b97befd-5fb1-4a1d-93f4-d7571f59583d service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4171436 Nov 11 14:23:59.524954 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00480b98-7449-4c15-a7fe-1493771dc898 req-cd18da24-bb53-4963-a3e4-7b525aad6e5f tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.526621 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-00480b98-7449-4c15-a7fe-1493771dc898 req-cd18da24-bb53-4963-a3e4-7b525aad6e5f tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 943 time: 0.1112142 Nov 11 14:23:59.607403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:23:59.641734 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1676270a-314b-482b-a80f-f262b7204376 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:23:59.643242 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,segment=NetworkSegment(1f5a608b-b556-45dc-b01f-3b9432671af9),segment_id=1f5a608b-b556-45dc-b01f-3b9432671af9)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:23:59.656915 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.662560 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-00480b98-7449-4c15-a7fe-1493771dc898 req-999f0b27-eb6f-4258-97bc-a7a409514811 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285527 Nov 11 14:23:59.667735 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7769d022-1186-46cd-b12f-406b613eac95 req-0181c635-e7af-4fe9-8873-0fa78948e4cb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.673588 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7769d022-1186-46cd-b12f-406b613eac95 req-0181c635-e7af-4fe9-8873-0fa78948e4cb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 931 time: 0.0743492 Nov 11 14:23:59.678537 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-c9d60788-a0ff-45be-8915-bdd2c154e741 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.680046 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-c9d60788-a0ff-45be-8915-bdd2c154e741 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1097 time: 0.0929198 Nov 11 14:23:59.681006 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Transition to ACTIVE for port object 1676270a-314b-482b-a80f-f262b7204376 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:23:59.751398 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58386) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:59.765217 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.770204 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-4aeae6f1-b92c-4017-b470-60b43549aa2f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.0809078 Nov 11 14:23:59.773913 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7769d022-1186-46cd-b12f-406b613eac95 req-b40220a3-80fc-45f4-9780-fd2cc7685663 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917163 Nov 11 14:23:59.812342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.813392 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.814991 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] 10.222.0.11 "PUT /v2.0/ports/801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 HTTP/1.1" status: 200 len: 1093 time: 1.2293131 Nov 11 14:23:59.815641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:23:59.826674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58390) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:23:59.827348 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:23:59.913642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9656fb45-f189-4219-8839-11a97d03cf23 service neutron] Pushing event updated for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:23:59.935755 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-0db3bdf6-7900-42e2-8bc2-56f8e9790023 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:23:59.937347 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-0db3bdf6-7900-42e2-8bc2-56f8e9790023 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.1539178 Nov 11 14:23:59.940553 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Pushing event updated for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:00.011208 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-bd4dbcc3-1205-40ca-8a81-f38a8def295b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0667388 Nov 11 14:24:00.013661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Attempting to bind port 1676270a-314b-482b-a80f-f262b7204376 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:24:00.015539 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Attempting to bind port 1676270a-314b-482b-a80f-f262b7204376 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:24:00.015539 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Attempting to bind port 1676270a-314b-482b-a80f-f262b7204376 on network bc415290-2d4a-450f-b1bb-bf8153b56614 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:24:00.018895 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Port 1676270a-314b-482b-a80f-f262b7204376 on network bc415290-2d4a-450f-b1bb-bf8153b56614 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:24:00.019864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Attempting to bind port 1676270a-314b-482b-a80f-f262b7204376 on network bc415290-2d4a-450f-b1bb-bf8153b56614 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:24:00.032818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 23, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:24:00.033152 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Checking segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:24:00.033608 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Bound using segment: {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:24:00.033951 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Bound port: 1676270a-314b-482b-a80f-f262b7204376, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 346, 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:24:00.034324 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.152872 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-227d580c-7cb3-40e7-9096-2911c11e857e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.216733 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:24:00.224309 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-34af0b6a-ed25-4474-b4f6-dee6618db0bd service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2014422 Nov 11 14:24:00.235206 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=1676270a-314b-482b-a80f-f262b7204376,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:24:00.292303 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9" -d '{"events": [{"name": "network-changed", "server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:24:00.309906 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f14f102-c198-44eb-9576-4c7924543464 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.343161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-7d3229f3-42a9-4dc9-86ec-0497beee7d7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:00.345772 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-7d3229f3-42a9-4dc9-86ec-0497beee7d7a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=bdc0ecb12a544f42ac73824cb88fff50&device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 1096 time: 0.3203516 Nov 11 14:24:00.353983 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.453824 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-771b113b-308a-40a9-bdcc-167a571bff66 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 HTTP/1.1" status: 200 len: 217 time: 0.0963635 Nov 11 14:24:00.482391 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:00.483014 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.486955 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] 10.222.0.11 "PUT /v2.0/ports/1676270a-314b-482b-a80f-f262b7204376 HTTP/1.1" status: 200 len: 1093 time: 1.9017372 Nov 11 14:24:00.501137 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-227d580c-7cb3-40e7-9096-2911c11e857e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.507795 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'tag': '1676270a-314b-482b-a80f-f262b7204376'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:24:00.514670 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d282f100-885b-4fee-8d96-9bbc552add04" -d '{"events": [{"name": "network-changed", "server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "tag": "1676270a-314b-482b-a80f-f262b7204376"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:24:00.524156 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0897443e-b1e4-4ef5-a04b-1c4be542cc6b req-cf0dfc2f-d2c7-49df-bac8-fb60b58419fb service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2909093 Nov 11 14:24:00.590841 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-5cb75165-7dcd-4f75-92d8-9461002e8594 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:00.591328 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175209ce-53f0-4cdf-82d1-a9479f9d05f1 service neutron] Pushing event updated for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:00.593309 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-5cb75165-7dcd-4f75-92d8-9461002e8594 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=f61b21b8-9633-4547-a15b-20ec2c3f175f HTTP/1.1" status: 200 len: 852 time: 0.1223402 Nov 11 14:24:00.629959 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:24:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16fc0a3a-3670-4474-ae67-838adaeb7f2e x-openstack-request-id: req-16fc0a3a-3670-4474-ae67-838adaeb7f2e {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:24:00.629959 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "tag": "1676270a-314b-482b-a80f-f262b7204376", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:24:00.629959 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-16fc0a3a-3670-4474-ae67-838adaeb7f2e {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:24:00.631881 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'tag': '1676270a-314b-482b-a80f-f262b7204376', 'status': 'completed', 'code': 200} Nov 11 14:24:00.664601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-227d580c-7cb3-40e7-9096-2911c11e857e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.689354 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-3fad931c-77c8-4f81-9ff9-e07bad3b0274 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c5b58dcb-77a0-4901-9126-308811d4244f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0870523 Nov 11 14:24:00.738537 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-227d580c-7cb3-40e7-9096-2911c11e857e admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=7c50e352dbfe471f87eefc2badf51f3f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9082780 Nov 11 14:24:00.741380 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227d580c-7cb3-40e7-9096-2911c11e857e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a91163ec-fdd4-413c-a0e1-5d1992448bdf,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:00.761351 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58436) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:00.819162 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-0960ff3e-0fcf-4b8e-9b41-977a7c36f8a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:00.820062 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-0960ff3e-0fcf-4b8e-9b41-977a7c36f8a9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 1096 time: 0.1387827 Nov 11 14:24:00.866196 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f14f102-c198-44eb-9576-4c7924543464 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.891892 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-bf1b16fc-6496-4b31-9260-55786fb8bc71 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=1676270a-314b-482b-a80f-f262b7204376 HTTP/1.1" status: 200 len: 217 time: 0.0617902 Nov 11 14:24:00.893427 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.913256 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:24:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13983ed1-67e8-4a38-9126-8153d1469fc6 x-openstack-request-id: req-13983ed1-67e8-4a38-9126-8153d1469fc6 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:24:00.913540 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:24:00.917510 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-13983ed1-67e8-4a38-9126-8153d1469fc6 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:24:00.917510 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74', 'status': 'completed', 'code': 200} Nov 11 14:24:00.944520 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-44c18bde-67ed-486f-b0c4-3ab70184ea40 service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2442579 Nov 11 14:24:00.953101 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1619146e-5cf7-4b33-8551-97365161a2df req-ed01c5f3-c64b-43ff-bff5-ec1534385f4e tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:00.954571 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1619146e-5cf7-4b33-8551-97365161a2df req-ed01c5f3-c64b-43ff-bff5-ec1534385f4e tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 943 time: 0.0982389 Nov 11 14:24:00.964537 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:00.980214 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5f14f102-c198-44eb-9576-4c7924543464 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.019164 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-feb641aa-600b-4297-b103-9f60178c6749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.020929 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-feb641aa-600b-4297-b103-9f60178c6749 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.1228764 Nov 11 14:24:01.083167 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f14f102-c198-44eb-9576-4c7924543464 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed582f96-8dfb-4800-9b7f-13688acb078d,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:01.091754 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-5f14f102-c198-44eb-9576-4c7924543464 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=22093da681b9494ba8f3c685f0b60ab6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3392057 Nov 11 14:24:01.095745 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-04b41c60-f88b-48ed-ab7f-8205c6c72b56 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0643470 Nov 11 14:24:01.096204 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58446) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:01.115523 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1619146e-5cf7-4b33-8551-97365161a2df req-d278f782-75fc-493e-b0c7-c1d1ee01e8c0 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424646 Nov 11 14:24:01.126989 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c95558c-c658-493a-88a6-f7e682e7e457 req-7908b3ee-4e46-470b-beab-d3ea1ea001e2 service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1714694 Nov 11 14:24:01.136446 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f72896f-d6f9-4fdf-b930-0ef3ae431326 req-64558646-fd34-4846-aa73-c1af4dbb6ce8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.153313 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f72896f-d6f9-4fdf-b930-0ef3ae431326 req-64558646-fd34-4846-aa73-c1af4dbb6ce8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 943 time: 0.1955419 Nov 11 14:24:01.185690 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.188326 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.192337 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/a91163ec-fdd4-413c-a0e1-5d1992448bdf HTTP/1.1" status: 204 len: 168 time: 0.4249852 Nov 11 14:24:01.277154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb97db48-9dd5-4cdc-a4bc-cd37c3d75552 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a91163ec-fdd4-413c-a0e1-5d1992448bdf,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:01.307377 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f72896f-d6f9-4fdf-b930-0ef3ae431326 req-58c547da-8a0a-4fa6-a697-d15ad9c11696 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531699 Nov 11 14:24:01.316870 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.324694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-7a3c0b7b-a95c-42f6-b2d1-c9831b950340 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.326414 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-7a3c0b7b-a95c-42f6-b2d1-c9831b950340 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=bdc0ecb12a544f42ac73824cb88fff50&device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 1096 time: 0.0660863 Nov 11 14:24:01.331278 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-21142d60-e0aa-4110-8f22-704ec950ba16 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2160597 Nov 11 14:24:01.372469 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.484423 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d24507f7-e31c-4668-b5f3-45ed4f99f302 req-852b80bb-ecc2-47d1-a2d1-9f78186756c8 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1413019 Nov 11 14:24:01.579884 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-198c7183-5446-475e-84f7-828e0b31d621 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.581448 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-198c7183-5446-475e-84f7-828e0b31d621 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c5b58dcb-77a0-4901-9126-308811d4244f HTTP/1.1" status: 200 len: 913 time: 0.2370229 Nov 11 14:24:01.616918 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.620343 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:01.621715 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/ed582f96-8dfb-4800-9b7f-13688acb078d HTTP/1.1" status: 204 len: 168 time: 0.5219502 Nov 11 14:24:01.629592 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-b69c5f44-024f-470f-af1d-db200c4b8fb2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 HTTP/1.1" status: 200 len: 217 time: 0.0397849 Nov 11 14:24:01.637892 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab75f6f0-ab38-4f21-83cc-45cc3735a1b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed582f96-8dfb-4800-9b7f-13688acb078d,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:01.691978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-2a70ded8-c4ce-4858-bdbe-521704b8db3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.693496 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-2a70ded8-c4ce-4858-bdbe-521704b8db3f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=f61b21b8-9633-4547-a15b-20ec2c3f175f HTTP/1.1" status: 200 len: 852 time: 0.0556009 Nov 11 14:24:01.735930 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-6979f6ca-3ff4-43e7-88fd-45624c5ca40e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c5b58dcb-77a0-4901-9126-308811d4244f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0308316 Nov 11 14:24:01.755803 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d282f100-885b-4fee-8d96-9bbc552add04 req-7c9cb57d-83db-492a-be05-c15315d285f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.757306 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-7c9cb57d-83db-492a-be05-c15315d285f0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 1096 time: 0.0523002 Nov 11 14:24:01.856036 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-dd8637e9-eb9e-47dd-ad5e-21a6665cc960 service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1084468 Nov 11 14:24:01.928128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d282f100-885b-4fee-8d96-9bbc552add04 req-e92214af-ba02-4c84-8205-33e47a1db1b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:01.930475 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-e92214af-ba02-4c84-8205-33e47a1db1b8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.1642401 Nov 11 14:24:01.973836 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ccb426d4-547e-4e74-a122-4dcfc7bd12c9 req-3ec1224b-0123-480b-ae88-21083edb4d7e service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1109672 Nov 11 14:24:02.153121 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-b5329e0a-d69c-451d-b196-334c744934f7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=1676270a-314b-482b-a80f-f262b7204376 HTTP/1.1" status: 200 len: 217 time: 0.2143021 Nov 11 14:24:02.210681 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d282f100-885b-4fee-8d96-9bbc552add04 req-651ad49c-bbcb-4390-8d9a-5cab482ae0bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:02.212153 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-651ad49c-bbcb-4390-8d9a-5cab482ae0bb service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.0511401 Nov 11 14:24:02.246673 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-89304b3d-7f10-49eb-87c1-6b57a3dafd70 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257034 Nov 11 14:24:02.256089 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1f6949-f2df-4ce9-9a50-c8cc9f07377d req-e56136fd-74c8-4f1d-8f00-0390d0288c09 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:02.257564 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cb1f6949-f2df-4ce9-9a50-c8cc9f07377d req-e56136fd-74c8-4f1d-8f00-0390d0288c09 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 943 time: 0.0539451 Nov 11 14:24:02.337312 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cb1f6949-f2df-4ce9-9a50-c8cc9f07377d req-0ca0b779-679e-472f-b81a-36292c1ed000 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685601 Nov 11 14:24:02.355280 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:24:02.359508 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58504) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:02.377886 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-c3d76ec6-e884-489f-82e9-76a97db83056 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245294 Nov 11 14:24:02.379297 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-02fd087d-9ee6-42dd-b4fd-e4984819c3f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:02.536850 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc22f826-4030-439e-9312-bef803796465 req-4bd6a38f-2a24-4094-b2f4-8a2bdf736aa5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:02.538321 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cc22f826-4030-439e-9312-bef803796465 req-4bd6a38f-2a24-4094-b2f4-8a2bdf736aa5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 943 time: 0.1409349 Nov 11 14:24:02.589844 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d282f100-885b-4fee-8d96-9bbc552add04 req-2d1cb14a-9be6-4cb1-95e2-90c669a6be3d service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2021255 Nov 11 14:24:02.620293 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-02fd087d-9ee6-42dd-b4fd-e4984819c3f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:02.627434 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cc22f826-4030-439e-9312-bef803796465 req-3928bc1b-7d35-4279-8591-c9a418bf3f78 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801935 Nov 11 14:24:02.718950 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-02fd087d-9ee6-42dd-b4fd-e4984819c3f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:02.770076 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fd087d-9ee6-42dd-b4fd-e4984819c3f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4b5558f-e15c-4f76-8a2d-a198838f81cf,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:02.779486 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58528) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:02.780516 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-02fd087d-9ee6-42dd-b4fd-e4984819c3f9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=9c4acca296a048febc45a81e066d164f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4187782 Nov 11 14:24:02.839345 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:02.860905 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.016453 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.019721 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.022130 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b4b5558f-e15c-4f76-8a2d-a198838f81cf HTTP/1.1" status: 204 len: 168 time: 0.2408500 Nov 11 14:24:03.032001 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e4e696-442f-4c50-bc67-b55328af8452 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4b5558f-e15c-4f76-8a2d-a198838f81cf,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:03.466434 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58562) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:03.508282 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69a469a-7624-4ff6-8219-8cc7956f5e86 req-97a7c0d1-cdfe-4f53-9d72-696697b8925c tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:03.510050 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c69a469a-7624-4ff6-8219-8cc7956f5e86 req-97a7c0d1-cdfe-4f53-9d72-696697b8925c tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 943 time: 0.0877192 Nov 11 14:24:03.593078 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c69a469a-7624-4ff6-8219-8cc7956f5e86 req-4a0cf2bb-29cd-41c6-b35a-2c87b4029a70 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763726 Nov 11 14:24:03.635831 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e31de31c-c964-480e-a6f9-539902c982b0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.739348 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e31de31c-c964-480e-a6f9-539902c982b0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.758738 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e0f660b-c6f1-4865-b127-4dd2bd783a35 req-594dcd55-de67-4505-a30b-9000a7f76396 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:03.760224 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3e0f660b-c6f1-4865-b127-4dd2bd783a35 req-594dcd55-de67-4505-a30b-9000a7f76396 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 943 time: 0.0593753 Nov 11 14:24:03.812942 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3e0f660b-c6f1-4865-b127-4dd2bd783a35 req-100d9280-4e89-42ca-bf5f-e1dbe976a58d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466180 Nov 11 14:24:03.833409 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e31de31c-c964-480e-a6f9-539902c982b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.879899 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e31de31c-c964-480e-a6f9-539902c982b0 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=ace8eac43e6142b896a042e73d6c4852&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4122810 Nov 11 14:24:03.880789 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58578) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:03.882026 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e31de31c-c964-480e-a6f9-539902c982b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d62321b9-27e2-4688-8222-fd7449d632fb,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:03.931171 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:03.951597 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:04.095048 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:04.098341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:04.099581 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/d62321b9-27e2-4688-8222-fd7449d632fb HTTP/1.1" status: 204 len: 168 time: 0.2163472 Nov 11 14:24:04.107331 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf4afbc-98db-4996-a315-6565c3aed71f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d62321b9-27e2-4688-8222-fd7449d632fb,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:04.601215 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 1676270a-314b-482b-a80f-f262b7204376 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:24:04.716789 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79843073-e5af-43ca-afe4-e62a3ca04ddb req-484b843a-0e46-4f19-ac9e-8fa252acbe70 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:04.718564 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-79843073-e5af-43ca-afe4-e62a3ca04ddb req-484b843a-0e46-4f19-ac9e-8fa252acbe70 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 943 time: 0.0540752 Nov 11 14:24:04.773252 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-79843073-e5af-43ca-afe4-e62a3ca04ddb req-1b9c4f5b-d30d-455b-a529-7a2ec0e983f4 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462513 Nov 11 14:24:04.829399 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=1676270a-314b-482b-a80f-f262b7204376,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:04.845160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '1676270a-314b-482b-a80f-f262b7204376', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'port_id': '1676270a-314b-482b-a80f-f262b7204376', 'mac_address': 'fa:16:3e:01:dd:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 346, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:24:04.854972 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58622) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:04.873125 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-10d24d38-38ac-42b5-a0a7-a3bddb4e1f1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:04.902342 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:04.917088 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1676270a-314b-482b-a80f-f262b7204376 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:24:04.938160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=1676270a-314b-482b-a80f-f262b7204376,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:04.971045 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2592a7e-b3ec-4e11-bec1-18984868d91e req-bce16dee-41d6-4540-93fd-40deebcc10cb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:04.972627 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b2592a7e-b3ec-4e11-bec1-18984868d91e req-bce16dee-41d6-4540-93fd-40deebcc10cb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 943 time: 0.0797918 Nov 11 14:24:05.021951 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-10d24d38-38ac-42b5-a0a7-a3bddb4e1f1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.039112 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b2592a7e-b3ec-4e11-bec1-18984868d91e req-dc5cd59c-8d2b-4220-923d-b87b5ef2c55a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586035 Nov 11 14:24:05.083657 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.084326 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device d3c800de-17fd-4c53-9b7d-1fcce1047246 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:24:05.152869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:05.158218 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:05.163770 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-10d24d38-38ac-42b5-a0a7-a3bddb4e1f1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.176094 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'd3c800de-17fd-4c53-9b7d-1fcce1047246', 'network_id': 'bc415290-2d4a-450f-b1bb-bf8153b56614', 'port_id': 'd3c800de-17fd-4c53-9b7d-1fcce1047246', 'mac_address': 'fa:16:3e:cf:e9:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 346, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9d424b9f-e0e9-479a-ab04-c4aa25cf128d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:24:05.217123 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.226615 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-10d24d38-38ac-42b5-a0a7-a3bddb4e1f1a admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=e573498b63a54f49b304cf15b32f132c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3703387 Nov 11 14:24:05.228359 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d24d38-38ac-42b5-a0a7-a3bddb4e1f1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f76c9a1b-33ef-4442-a986-5b645eea9172,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:05.229265 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58634) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:05.234627 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d3c800de-17fd-4c53-9b7d-1fcce1047246 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:24:05.271177 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:05.295711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.317321 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.386554 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.387467 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:24:05.459668 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:05.460514 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.463234 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.467130 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/f76c9a1b-33ef-4442-a986-5b645eea9172 HTTP/1.1" status: 204 len: 168 time: 0.2342267 Nov 11 14:24:05.478701 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3715e2-4b8c-40b0-aaac-a0e035838c8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f76c9a1b-33ef-4442-a986-5b645eea9172,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:05.532516 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,segment=NetworkSegment(1f5a608b-b556-45dc-b01f-3b9432671af9),segment_id=1f5a608b-b556-45dc-b01f-3b9432671af9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:05.547901 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74', 'network_id': 'c5b58dcb-77a0-4901-9126-308811d4244f', 'port_id': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74', 'mac_address': 'fa:16:3e:1f:68:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 332, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f61b21b8-9633-4547-a15b-20ec2c3f175f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:24:05.586377 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.601482 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:24:05.622481 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,segment=NetworkSegment(1f5a608b-b556-45dc-b01f-3b9432671af9),segment_id=1f5a608b-b556-45dc-b01f-3b9432671af9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:05.696632 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:05.748354 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:05.971587 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4270ab-e1dd-485b-aa00-5706285254b6 req-4c37b9e1-8b19-425d-a124-1aa1be64e4d3 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:05.979479 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6b4270ab-e1dd-485b-aa00-5706285254b6 req-4c37b9e1-8b19-425d-a124-1aa1be64e4d3 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.1012392 Nov 11 14:24:06.020063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['d3c800de-17fd-4c53-9b7d-1fcce1047246'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:24:06.038060 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6b4270ab-e1dd-485b-aa00-5706285254b6 req-3ceed5ba-2f11-42e5-8dec-537c82ce0d38 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505941 Nov 11 14:24:06.080407 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:24:06.145636 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['1676270a-314b-482b-a80f-f262b7204376'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:24:06.148359 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-170ac97f-eae9-433d-b260-ebe5b88cfaaf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:06.216955 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7238f9f-38a8-4b98-b6ab-bb001435c749 req-ee4f4570-5f5d-465e-86f7-d16667849e82 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:06.225615 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7238f9f-38a8-4b98-b6ab-bb001435c749 req-ee4f4570-5f5d-465e-86f7-d16667849e82 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0895951 Nov 11 14:24:06.295697 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7238f9f-38a8-4b98-b6ab-bb001435c749 req-476cd4c4-ef5e-45a7-b769-215fe26b407b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636992 Nov 11 14:24:07.175629 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ef6f29d-7d0c-4d2d-81e1-263aa2afe2ca req-b7f95ab0-e7de-4c94-8f40-a72bedb1f71a tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:07.178084 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3ef6f29d-7d0c-4d2d-81e1-263aa2afe2ca req-b7f95ab0-e7de-4c94-8f40-a72bedb1f71a tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0795724 Nov 11 14:24:07.234342 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58780) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:07.244192 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3ef6f29d-7d0c-4d2d-81e1-263aa2afe2ca req-7a9e77a6-a027-435e-b444-ff1328f017e2 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603774 Nov 11 14:24:07.451144 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9429fbca-2bfb-43b3-a811-c515657f13fb req-63a64ba0-dda6-4405-b3cf-6c7f323944c9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:07.452803 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9429fbca-2bfb-43b3-a811-c515657f13fb req-63a64ba0-dda6-4405-b3cf-6c7f323944c9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0674322 Nov 11 14:24:07.459730 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df84b795-6f82-4740-8784-5d6527b61f47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.533704 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9429fbca-2bfb-43b3-a811-c515657f13fb req-627dc21d-cc96-4a09-8606-7c4ff4480366 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715175 Nov 11 14:24:07.588438 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df84b795-6f82-4740-8784-5d6527b61f47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.633545 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df84b795-6f82-4740-8784-5d6527b61f47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.674955 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-df84b795-6f82-4740-8784-5d6527b61f47 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d73cff67fbd14a71afc303cee33dbfcf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4362967 Nov 11 14:24:07.674955 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df84b795-6f82-4740-8784-5d6527b61f47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aed5b788-49b1-42aa-a7f8-3af29f0c7dc1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:07.676699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58814) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:07.737449 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.759799 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.907932 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.910591 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:07.911773 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/aed5b788-49b1-42aa-a7f8-3af29f0c7dc1 HTTP/1.1" status: 204 len: 168 time: 0.2341683 Nov 11 14:24:07.924117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a8d019-9c17-43f1-b471-fdc10ca0932d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aed5b788-49b1-42aa-a7f8-3af29f0c7dc1,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:08.366627 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62c5ed1a-b064-41ea-9c17-30dbb76538e8 req-e20d34c7-1ba6-4438-ac05-bcec2a1641a1 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:08.368190 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-62c5ed1a-b064-41ea-9c17-30dbb76538e8 req-e20d34c7-1ba6-4438-ac05-bcec2a1641a1 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0590398 Nov 11 14:24:08.416926 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-62c5ed1a-b064-41ea-9c17-30dbb76538e8 req-bbd3bb47-a001-4696-b203-9c8722478bca tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428922 Nov 11 14:24:08.451097 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58846) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:08.478193 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-518753ed-eef0-43bc-93cd-0ecf5df05b67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.556790 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a4479f7b-be38-4090-9972-6dba8f2b7b0d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.665766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a4479f7b-be38-4090-9972-6dba8f2b7b0d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.674391 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3d0ac7-0490-447d-b7b9-664f548077a3 req-5537fba5-ecf5-4532-8721-edccc7641341 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:08.676478 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5e3d0ac7-0490-447d-b7b9-664f548077a3 req-5537fba5-ecf5-4532-8721-edccc7641341 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0727034 Nov 11 14:24:08.692277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58854) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:08.704852 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-49e59544-61ed-401e-b909-01b1f6a6d52c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.724857 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5e3d0ac7-0490-447d-b7b9-664f548077a3 req-e72b675a-d45d-4ce0-bee8-ac15f5dc3c31 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423822 Nov 11 14:24:08.747736 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-a4479f7b-be38-4090-9972-6dba8f2b7b0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.779677 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-49e59544-61ed-401e-b909-01b1f6a6d52c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.788347 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-a4479f7b-be38-4090-9972-6dba8f2b7b0d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=791e74c674b2470faa9809e1ed306ea1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3361485 Nov 11 14:24:08.790305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4479f7b-be38-4090-9972-6dba8f2b7b0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9f97e88-9fa0-49bc-9e9d-b60978a45078,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:08.791023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 58856) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:08.844229 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.865059 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.871118 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-49e59544-61ed-401e-b909-01b1f6a6d52c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:08.927474 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-49e59544-61ed-401e-b909-01b1f6a6d52c admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d7b61f0b8c7340d3a625ac38202755ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2340648 Nov 11 14:24:08.928164 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e59544-61ed-401e-b909-01b1f6a6d52c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3af6041-6c13-4fa9-892e-a88749228f56,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:08.930052 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58858) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:08.978641 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.000423 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.016462 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.023075 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.023075 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/c9f97e88-9fa0-49bc-9e9d-b60978a45078 HTTP/1.1" status: 204 len: 168 time: 0.2286444 Nov 11 14:24:09.029674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d596b02b-00f9-4e9e-83fc-fbbd4879b68b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9f97e88-9fa0-49bc-9e9d-b60978a45078,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:09.130487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.133161 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.134394 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b3af6041-6c13-4fa9-892e-a88749228f56 HTTP/1.1" status: 204 len: 168 time: 0.2032576 Nov 11 14:24:09.142548 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aaa9861-0664-4e72-b6a1-aa7f08852b17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3af6041-6c13-4fa9-892e-a88749228f56,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:09.559751 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cdac418-832e-4b8a-8fac-c4295cd72aeb req-f29e3169-661d-4ecb-99ca-39a99b9a2de6 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:09.561726 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6cdac418-832e-4b8a-8fac-c4295cd72aeb req-f29e3169-661d-4ecb-99ca-39a99b9a2de6 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0702324 Nov 11 14:24:09.608514 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6cdac418-832e-4b8a-8fac-c4295cd72aeb req-d6ffff3e-02f7-4a30-8cca-bc00f2992cdf tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410531 Nov 11 14:24:09.661768 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.791165 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58890) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:09.813128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1349f96-4493-4abb-8f2f-40f6d467d2fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:09.896245 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99aaa541-bb0b-40e6-bbb4-bc080b19d5f6 req-4d2e52e2-76a5-47fc-9c91-068e1094a8c8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:09.897742 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-99aaa541-bb0b-40e6-bbb4-bc080b19d5f6 req-4d2e52e2-76a5-47fc-9c91-068e1094a8c8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0990400 Nov 11 14:24:09.975330 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-99aaa541-bb0b-40e6-bbb4-bc080b19d5f6 req-84c8aabc-5086-48f0-94c9-9fb3f3a0a1a7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700893 Nov 11 14:24:09.979925 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1349f96-4493-4abb-8f2f-40f6d467d2fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.032304 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1349f96-4493-4abb-8f2f-40f6d467d2fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.071606 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f1349f96-4493-4abb-8f2f-40f6d467d2fb admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=7d0042900e02402585f4684fe30e5b0a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2792668 Nov 11 14:24:10.072846 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1349f96-4493-4abb-8f2f-40f6d467d2fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09f36cec-933c-47d6-8ced-3e3f26ed44f2,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:10.075559 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 58902) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:10.132271 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.155129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.272113 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.274713 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.275899 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/09f36cec-933c-47d6-8ced-3e3f26ed44f2 HTTP/1.1" status: 204 len: 168 time: 0.1994157 Nov 11 14:24:10.285084 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b67755e-60e0-4d66-818b-d5de09d9e1fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09f36cec-933c-47d6-8ced-3e3f26ed44f2,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:10.714451 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:10.741535 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e286547d-ffab-4ff0-bcc0-889ffb42a7ee req-79c57945-0b2c-4f25-9e00-ae02693b310b tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:10.744508 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e286547d-ffab-4ff0-bcc0-889ffb42a7ee req-79c57945-0b2c-4f25-9e00-ae02693b310b tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0626192 Nov 11 14:24:10.793844 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e286547d-ffab-4ff0-bcc0-889ffb42a7ee req-aac68465-e575-4337-a5a8-903f12334fa2 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442967 Nov 11 14:24:11.094158 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e9ba99-0e21-4866-bb4c-b04420c69a03 req-3c536499-bef2-4ac8-8776-c8e7d785484f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:11.095644 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a3e9ba99-0e21-4866-bb4c-b04420c69a03 req-3c536499-bef2-4ac8-8776-c8e7d785484f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0503702 Nov 11 14:24:11.161963 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a3e9ba99-0e21-4866-bb4c-b04420c69a03 req-7e6fa13f-c2ed-45d4-9412-d876178973bc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602548 Nov 11 14:24:11.723744 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:11.908960 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b3fe13-3c2e-403b-937d-d873f83db015 req-79234e09-3eb7-47a1-be01-7f25af16f103 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:11.910991 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-00b3fe13-3c2e-403b-937d-d873f83db015 req-79234e09-3eb7-47a1-be01-7f25af16f103 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0496285 Nov 11 14:24:11.958258 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-00b3fe13-3c2e-403b-937d-d873f83db015 req-418b5ec6-cd5c-48c3-99f4-fa2136a9983f tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412388 Nov 11 14:24:11.998794 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:12.271312 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4051902-9d5f-47dd-8b80-ee89064923fd req-1d3364c6-c4f8-42a7-8978-14a0ee1f742b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:12.272894 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a4051902-9d5f-47dd-8b80-ee89064923fd req-1d3364c6-c4f8-42a7-8978-14a0ee1f742b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0495625 Nov 11 14:24:12.319889 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a4051902-9d5f-47dd-8b80-ee89064923fd req-f2206676-00ea-4247-b256-4a6eda0a05ca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410147 Nov 11 14:24:13.069452 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331a9e9d-bf4d-49eb-b2a8-3b6e22da46e5 req-f432c171-2bdb-47f0-9be6-6f7f2d83bdc5 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:13.075428 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-331a9e9d-bf4d-49eb-b2a8-3b6e22da46e5 req-f432c171-2bdb-47f0-9be6-6f7f2d83bdc5 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0484505 Nov 11 14:24:13.120116 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-331a9e9d-bf4d-49eb-b2a8-3b6e22da46e5 req-c247e97c-3fbe-4b10-8818-247b56b824cf tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431859 Nov 11 14:24:13.431811 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d25e324-4477-4c14-82b1-406777da6775 req-b0deddc7-8d98-4815-83c3-96e04d917834 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:13.433267 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3d25e324-4477-4c14-82b1-406777da6775 req-b0deddc7-8d98-4815-83c3-96e04d917834 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 944 time: 0.0480344 Nov 11 14:24:13.479457 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3d25e324-4477-4c14-82b1-406777da6775 req-2b4593ea-c5f4-41e6-8ceb-e7e938e7f7f1 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403137 Nov 11 14:24:13.560226 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 1676270a-314b-482b-a80f-f262b7204376 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:24:13.690610 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 1676270a-314b-482b-a80f-f262b7204376 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:24:13.695381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 1676270a-314b-482b-a80f-f262b7204376 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:24:13.695775 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:13.771710 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:13.793635 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1676270a-314b-482b-a80f-f262b7204376'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:24:13.871556 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=1676270a-314b-482b-a80f-f262b7204376,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:13.931029 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:13.932317 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device d3c800de-17fd-4c53-9b7d-1fcce1047246 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:24:13.977905 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e166f38-2622-4199-b401-35d103ff87c8" -d '{"events": [{"server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "name": "network-vif-plugged", "status": "completed", "tag": "1676270a-314b-482b-a80f-f262b7204376"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:24:14.018278 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:14.083208 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:24:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a261cbe1-c8ae-4f83-8368-406aecd6a842 x-openstack-request-id: req-a261cbe1-c8ae-4f83-8368-406aecd6a842 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:24:14.083548 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "name": "network-vif-plugged", "status": "completed", "tag": "1676270a-314b-482b-a80f-f262b7204376", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:24:14.083808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a261cbe1-c8ae-4f83-8368-406aecd6a842 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:24:14.084268 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1676270a-314b-482b-a80f-f262b7204376', 'code': 200} Nov 11 14:24:14.094808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port d3c800de-17fd-4c53-9b7d-1fcce1047246 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:24:14.098824 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port d3c800de-17fd-4c53-9b7d-1fcce1047246 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:24:14.099186 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.202808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.237281 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:14.247521 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b89d295-bb31-4140-955b-ebed1211db34 req-349edee4-dac9-46cd-94fd-dda2422edf77 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:14.248980 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7b89d295-bb31-4140-955b-ebed1211db34 req-349edee4-dac9-46cd-94fd-dda2422edf77 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 944 time: 0.0564697 Nov 11 14:24:14.296861 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7b89d295-bb31-4140-955b-ebed1211db34 req-93579f2c-1ed3-4102-8181-f65cdcd02b31 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411503 Nov 11 14:24:14.347543 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.348293 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:24:14.423582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:14.501440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:24:14.507328 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:24:14.507732 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.598611 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cdbe070-8e14-474d-8b27-ea5e7fa3e744 req-8ed8f813-9898-4bca-abbf-098536fc44ea tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:14.600679 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3cdbe070-8e14-474d-8b27-ea5e7fa3e744 req-8ed8f813-9898-4bca-abbf-098536fc44ea tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0510194 Nov 11 14:24:14.601414 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.637056 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,segment=NetworkSegment(1f5a608b-b556-45dc-b01f-3b9432671af9),segment_id=1f5a608b-b556-45dc-b01f-3b9432671af9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:14.647451 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3cdbe070-8e14-474d-8b27-ea5e7fa3e744 req-1163ec01-90c8-4d9c-afb7-406d7ee6aba3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402279 Nov 11 14:24:14.696410 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:14.744384 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:15.410665 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d84cacc5-6136-43c4-b164-68fe4206e85b req-2f81f339-aa5e-4b99-abf2-24cba5b97c36 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:15.412077 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d84cacc5-6136-43c4-b164-68fe4206e85b req-2f81f339-aa5e-4b99-abf2-24cba5b97c36 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0479348 Nov 11 14:24:15.459631 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d84cacc5-6136-43c4-b164-68fe4206e85b req-2612fee4-340d-4984-b498-c011801b87c6 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417995 Nov 11 14:24:15.761011 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eeb1387-e05a-4752-9c10-a2c3936aef47 req-2e8c749b-90ec-475b-ae50-0d25a67cfc68 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:15.762738 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2eeb1387-e05a-4752-9c10-a2c3936aef47 req-2e8c749b-90ec-475b-ae50-0d25a67cfc68 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0496244 Nov 11 14:24:15.763541 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-40e0a1bc-7b0e-4e06-a2d7-f490ce0718a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:15.765046 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-40e0a1bc-7b0e-4e06-a2d7-f490ce0718a6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 1098 time: 0.0728872 Nov 11 14:24:15.786005 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-1979646c-8835-4f0d-bb41-739213ec39e5 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:15.813689 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2eeb1387-e05a-4752-9c10-a2c3936aef47 req-5aeabc03-3000-483e-ba8c-e9139856a81e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442538 Nov 11 14:24:15.862279 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-1979646c-8835-4f0d-bb41-739213ec39e5 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:15.959170 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-1979646c-8835-4f0d-bb41-739213ec39e5 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:16.004540 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6a12f655-e3b2-44fc-9f2d-592ace0cc498 req-1979646c-8835-4f0d-bb41-739213ec39e5 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2320337 Nov 11 14:24:16.005253 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1979646c-8835-4f0d-bb41-739213ec39e5 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=a7b86bec-ae10-4ce7-a5bd-516dd2b977f4,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:16.085324 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246'}, {'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:24:16.088421 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2635663f-a87b-48db-ab72-ebd02455fd82" -d '{"events": [{"server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "name": "network-vif-plugged", "status": "completed", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246"}, {"server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "name": "network-vif-plugged", "status": "completed", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:24:16.127895 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 11 Nov 2021 14:24:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b2b4f18-c6a9-4048-9336-f65e90b26cd6 x-openstack-request-id: req-5b2b4f18-c6a9-4048-9336-f65e90b26cd6 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:24:16.128240 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "name": "network-vif-plugged", "status": "completed", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246", "code": 200}, {"server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "name": "network-vif-plugged", "status": "completed", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:24:16.128512 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-5b2b4f18-c6a9-4048-9336-f65e90b26cd6 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:24:16.128899 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246', 'code': 200} Nov 11 14:24:16.129151 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74', 'code': 200} Nov 11 14:24:16.575207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fa72de-a4d0-4ea5-97b2-55c8a69057bf req-4f9139ac-a8bf-403e-bba0-c8bc98eda02d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:16.576686 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-59fa72de-a4d0-4ea5-97b2-55c8a69057bf req-4f9139ac-a8bf-403e-bba0-c8bc98eda02d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0505593 Nov 11 14:24:16.625725 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-59fa72de-a4d0-4ea5-97b2-55c8a69057bf req-d4698697-b555-49c1-aed9-1a52a49cdab7 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423245 Nov 11 14:24:16.931177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8be8cdf-cd2e-434d-928e-66e6efcd38ad req-858f9e19-d634-4612-aa85-1c257dd94f0a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:16.932680 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e8be8cdf-cd2e-434d-928e-66e6efcd38ad req-858f9e19-d634-4612-aa85-1c257dd94f0a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0491648 Nov 11 14:24:16.983295 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e8be8cdf-cd2e-434d-928e-66e6efcd38ad req-34729a64-ffe8-4013-915c-212c22d7c79d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446758 Nov 11 14:24:17.736880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e77000-fc91-4264-87a2-678eaaf3a67d req-4ff326b1-c782-4d54-8e26-66ee9fbea258 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:17.738980 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-19e77000-fc91-4264-87a2-678eaaf3a67d req-4ff326b1-c782-4d54-8e26-66ee9fbea258 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0476811 Nov 11 14:24:17.783468 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-19e77000-fc91-4264-87a2-678eaaf3a67d req-5b5a72f9-b6f2-41b4-a96c-5426c2c7621d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386453 Nov 11 14:24:18.095655 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046430b3-6c92-4101-9931-10f849d6a71c req-b0644025-86c0-40c2-ac36-3420175670e5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:18.097094 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-046430b3-6c92-4101-9931-10f849d6a71c req-b0644025-86c0-40c2-ac36-3420175670e5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0473518 Nov 11 14:24:18.142735 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-046430b3-6c92-4101-9931-10f849d6a71c req-20cf5688-958a-420d-9096-82c9c674ee55 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391583 Nov 11 14:24:18.913916 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efccc1cd-e064-46ff-a887-1d4b1e9cb23f req-131a8683-6c61-4033-97b4-31f61ac21b67 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:18.915476 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-efccc1cd-e064-46ff-a887-1d4b1e9cb23f req-131a8683-6c61-4033-97b4-31f61ac21b67 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0651736 Nov 11 14:24:18.967402 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-efccc1cd-e064-46ff-a887-1d4b1e9cb23f req-632c45f0-d4e1-4234-962c-c2deec4639e0 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457287 Nov 11 14:24:19.199795 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640960bf-a07b-4a1e-a09e-3871927adbc6 req-98a0a919-c8df-493a-8fac-868eaee68bad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:19.201896 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-640960bf-a07b-4a1e-a09e-3871927adbc6 req-98a0a919-c8df-493a-8fac-868eaee68bad service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.0439508 Nov 11 14:24:19.252385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b4e6c2-c75a-419c-909a-1372b88d5b5c req-1e435cce-b337-4770-8fec-bf43ea998fcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:19.255667 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-77b4e6c2-c75a-419c-909a-1372b88d5b5c req-1e435cce-b337-4770-8fec-bf43ea998fcc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 1098 time: 0.0719342 Nov 11 14:24:19.283483 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-640960bf-a07b-4a1e-a09e-3871927adbc6 req-9468e247-e55b-4bf1-8bcd-b5e7513e4f98 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736301 Nov 11 14:24:19.297971 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4117cc62-518f-4bba-945e-fe5b551a28d8 req-2cc8c3e2-ba6f-4d03-8380-dcee9f7511b8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:19.299485 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4117cc62-518f-4bba-945e-fe5b551a28d8 req-2cc8c3e2-ba6f-4d03-8380-dcee9f7511b8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0833406 Nov 11 14:24:19.315557 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-77b4e6c2-c75a-419c-909a-1372b88d5b5c req-6a1a3f1b-e83b-435f-8351-3af748ac6a51 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530317 Nov 11 14:24:19.352038 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4117cc62-518f-4bba-945e-fe5b551a28d8 req-84f4d874-544c-4b3f-8033-f3df7244d488 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464084 Nov 11 14:24:20.236446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e83d72e-13aa-4838-b0b1-0677b1ea0516 req-9524edb9-e2bb-40ba-a2ee-7ee77461a4ba tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:20.239862 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5e83d72e-13aa-4838-b0b1-0677b1ea0516 req-9524edb9-e2bb-40ba-a2ee-7ee77461a4ba tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.1956491 Nov 11 14:24:20.286134 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5e83d72e-13aa-4838-b0b1-0677b1ea0516 req-2de2ab3b-ed2f-455e-aa2c-e3932aef936d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418172 Nov 11 14:24:20.471495 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23336ee7-7be1-45e2-933c-085fbf410067 req-edbe6971-45e6-445b-ba39-8beb6b543f0f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:20.473580 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-23336ee7-7be1-45e2-933c-085fbf410067 req-edbe6971-45e6-445b-ba39-8beb6b543f0f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0490065 Nov 11 14:24:20.518232 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-23336ee7-7be1-45e2-933c-085fbf410067 req-2f807087-cf55-4444-902b-71e5d9ef64f3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387721 Nov 11 14:24:20.970521 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59210) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:21.070178 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0b24667e-5c0d-4c2e-b52b-31a4579f366d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.140212 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0b24667e-5c0d-4c2e-b52b-31a4579f366d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.210408 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0b24667e-5c0d-4c2e-b52b-31a4579f366d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.249693 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-0b24667e-5c0d-4c2e-b52b-31a4579f366d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=0fc4c1558016422996a97b0ce7103edf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2780583 Nov 11 14:24:21.251533 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b24667e-5c0d-4c2e-b52b-31a4579f366d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa901c17-f9f0-4bc5-a210-e50f52c64796,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:21.252468 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59220) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:21.305115 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.329676 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.421653 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd53ab6-c3ca-4be5-b2cd-e5a280050649 req-2fbd756f-925a-4c81-9426-b6f89f0060bd tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:21.423244 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2bd53ab6-c3ca-4be5-b2cd-e5a280050649 req-2fbd756f-925a-4c81-9426-b6f89f0060bd tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0651045 Nov 11 14:24:21.471923 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2bd53ab6-c3ca-4be5-b2cd-e5a280050649 req-641dc940-d644-4a67-8aa8-d87430c961ec tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424602 Nov 11 14:24:21.536340 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.539005 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:21.540185 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/fa901c17-f9f0-4bc5-a210-e50f52c64796 HTTP/1.1" status: 204 len: 168 time: 0.2866199 Nov 11 14:24:21.548198 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-653de1bd-c6c5-42ab-94ac-ca8672368128 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa901c17-f9f0-4bc5-a210-e50f52c64796,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:21.648950 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8d9bb2-9fd5-43c1-b496-ac6ebe46c543 req-51d6a52c-bda3-4cc8-92ed-62395efa5261 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:21.650375 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5b8d9bb2-9fd5-43c1-b496-ac6ebe46c543 req-51d6a52c-bda3-4cc8-92ed-62395efa5261 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0509474 Nov 11 14:24:21.696778 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5b8d9bb2-9fd5-43c1-b496-ac6ebe46c543 req-d169016c-b8bc-4262-acec-8baadbc4228c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400949 Nov 11 14:24:22.131023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59236) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:22.143600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-593de084-fceb-42cf-86fa-467e47781d5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.235863 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-593de084-fceb-42cf-86fa-467e47781d5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.329027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-593de084-fceb-42cf-86fa-467e47781d5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.366502 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-593de084-fceb-42cf-86fa-467e47781d5b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=773e5d3c238b480f956434009c72debd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2343483 Nov 11 14:24:22.367294 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593de084-fceb-42cf-86fa-467e47781d5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae921508-6893-493c-b9ef-93b49c3fe159,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:22.369122 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59242) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:22.416475 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.436452 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.575979 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.578627 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:22.579776 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/ae921508-6893-493c-b9ef-93b49c3fe159 HTTP/1.1" status: 204 len: 168 time: 0.2096138 Nov 11 14:24:22.587735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2489c64f-0c43-4e4c-aaa1-13b72c468b13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae921508-6893-493c-b9ef-93b49c3fe159,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:22.595825 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa2677a-30d4-4e06-8272-c04aefbf921e req-84112502-b37a-481e-88be-c3be721d4eea tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:22.603119 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5fa2677a-30d4-4e06-8272-c04aefbf921e req-84112502-b37a-481e-88be-c3be721d4eea tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0647216 Nov 11 14:24:22.649732 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5fa2677a-30d4-4e06-8272-c04aefbf921e req-338f60df-a12f-4687-a940-83dd9660c353 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456631 Nov 11 14:24:22.810545 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2380e3e8-aa68-4ff5-b02f-829d0657bea0 req-8cbdeedc-972d-4478-b7e0-c35c0e3da1e5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:22.812085 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2380e3e8-aa68-4ff5-b02f-829d0657bea0 req-8cbdeedc-972d-4478-b7e0-c35c0e3da1e5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0509846 Nov 11 14:24:22.864114 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2380e3e8-aa68-4ff5-b02f-829d0657bea0 req-1ccaca93-007f-4baa-b7c7-d571c27ebd80 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452225 Nov 11 14:24:23.784304 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef017750-2239-4a05-98f8-ed55bd03631d req-411e2f6c-b01f-4599-bba7-5aab20ea5f9d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:23.791353 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef017750-2239-4a05-98f8-ed55bd03631d req-411e2f6c-b01f-4599-bba7-5aab20ea5f9d tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0750043 Nov 11 14:24:23.859027 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef017750-2239-4a05-98f8-ed55bd03631d req-ee1a9ad5-68de-4e19-827d-ad5d724f02ca tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612192 Nov 11 14:24:23.995696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebccfea-ebcb-44e0-b73b-19c1ae8d43ec req-3bed30e3-8e7b-41ea-bd35-e6df6d728876 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:23.997188 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-eebccfea-ebcb-44e0-b73b-19c1ae8d43ec req-3bed30e3-8e7b-41ea-bd35-e6df6d728876 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0538294 Nov 11 14:24:24.103965 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-eebccfea-ebcb-44e0-b73b-19c1ae8d43ec req-2df0762a-ef7f-4cc6-bcb7-15065058a31e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970466 Nov 11 14:24:24.244592 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59370) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:24.369032 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f9bdc493-97ff-422c-9cd7-f4115ae0271c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:24.451609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f9bdc493-97ff-422c-9cd7-f4115ae0271c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:24.564437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f9bdc493-97ff-422c-9cd7-f4115ae0271c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:24.630723 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f9bdc493-97ff-422c-9cd7-f4115ae0271c admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=af88ac233fc740359241487dda7a630e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3849177 Nov 11 14:24:24.633320 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59382) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:24.637089 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9bdc493-97ff-422c-9cd7-f4115ae0271c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0c0c08b-2e21-4366-93ed-765e6ed64e5f,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:24.653355 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acb2e70-4e1c-4e63-8d32-d221d8cd337f req-ea789a05-d66b-45f3-8369-08e3345e7267 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:24.654915 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2acb2e70-4e1c-4e63-8d32-d221d8cd337f req-ea789a05-d66b-45f3-8369-08e3345e7267 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.1018949 Nov 11 14:24:24.714350 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2acb2e70-4e1c-4e63-8d32-d221d8cd337f req-a4c63344-a89e-405e-a011-40167c5af74f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511715 Nov 11 14:24:24.744762 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fd9852-dd52-431c-9008-f1b21167b349 req-9d9e1018-4da0-4cf8-8e89-54c23f497fc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:24.746174 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-9d9e1018-4da0-4cf8-8e89-54c23f497fc8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 1098 time: 0.0698605 Nov 11 14:24:24.760519 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:24.790250 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:24.877844 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fd9852-dd52-431c-9008-f1b21167b349 req-0ea179c5-a5bd-49f8-8848-4d4b319b4b0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:24.879668 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-0ea179c5-a5bd-49f8-8848-4d4b319b4b0a service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.1152463 Nov 11 14:24:24.949541 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-b673c21a-66a9-43d4-b205-6fb2747bac24 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=1676270a-314b-482b-a80f-f262b7204376 HTTP/1.1" status: 200 len: 217 time: 0.0531878 Nov 11 14:24:25.021287 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fd9852-dd52-431c-9008-f1b21167b349 req-1ffa38dd-34a8-4f99-96aa-5abaa0246f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:25.022717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-1ffa38dd-34a8-4f99-96aa-5abaa0246f56 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.0635812 Nov 11 14:24:25.024494 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:25.027255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:25.028283 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/a0c0c08b-2e21-4366-93ed-765e6ed64e5f HTTP/1.1" status: 204 len: 168 time: 0.3939359 Nov 11 14:24:25.036590 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cbe8202-8d5a-408b-858c-4fdd4da041ac req-d48e1254-64bf-44ec-a7c1-0dc430e7f4a2 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:25.038012 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0cbe8202-8d5a-408b-858c-4fdd4da041ac req-d48e1254-64bf-44ec-a7c1-0dc430e7f4a2 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0910888 Nov 11 14:24:25.073268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-e6ede7e7-cf3d-4763-8cde-781b8601e5c7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343194 Nov 11 14:24:25.074163 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9c451b-9b40-4638-919e-0548c0bb320a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0c0c08b-2e21-4366-93ed-765e6ed64e5f,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:25.253808 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0cbe8202-8d5a-408b-858c-4fdd4da041ac req-3010021b-8099-47cd-8e62-5e19afae95b9 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211622 Nov 11 14:24:25.253808 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-1035c0eb-58bf-4a21-9168-9671d20c3bcb service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1179593 Nov 11 14:24:25.298082 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-27fd9852-dd52-431c-9008-f1b21167b349 req-4781190b-2905-4db1-81ff-b94d3ef7e94b service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880499 Nov 11 14:24:25.895048 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941b651d-1ae2-40e0-bd5f-5393be72c9aa req-b17351ed-2dbd-4f71-aa19-bfcb8b6d4ceb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:25.896552 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-941b651d-1ae2-40e0-bd5f-5393be72c9aa req-b17351ed-2dbd-4f71-aa19-bfcb8b6d4ceb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0512667 Nov 11 14:24:25.945982 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-941b651d-1ae2-40e0-bd5f-5393be72c9aa req-9edafcd2-1958-4e72-a9dd-ea72f583dca8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431657 Nov 11 14:24:26.027111 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59440) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:26.036952 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-42e9eead-c7b4-40ae-96a5-4b3795a3787f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.114751 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-42e9eead-c7b4-40ae-96a5-4b3795a3787f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.193083 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-42e9eead-c7b4-40ae-96a5-4b3795a3787f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.230040 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e9eead-c7b4-40ae-96a5-4b3795a3787f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3452fba6-9e4b-498b-96f3-0f21c7c1cc22,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:26.266691 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-42e9eead-c7b4-40ae-96a5-4b3795a3787f admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=3bc79f2d32a04a5c9ae76ed27b63f338&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2149630 Nov 11 14:24:26.267118 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59442) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:26.298208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.320162 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.462450 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.465590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:26.467003 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/3452fba6-9e4b-498b-96f3-0f21c7c1cc22 HTTP/1.1" status: 204 len: 168 time: 0.2273698 Nov 11 14:24:26.480854 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d392cd30-5980-48e7-96b6-6ec01c6391c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3452fba6-9e4b-498b-96f3-0f21c7c1cc22,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:27.065533 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18f24a7-23c6-478c-a8d3-cbbfee265a6d req-8638e1c5-bb78-4436-8054-4e340b54e809 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:27.067658 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f18f24a7-23c6-478c-a8d3-cbbfee265a6d req-8638e1c5-bb78-4436-8054-4e340b54e809 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0534534 Nov 11 14:24:27.120095 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f18f24a7-23c6-478c-a8d3-cbbfee265a6d req-37e7bfae-6b4b-454c-b96c-7171fc82e7f7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462863 Nov 11 14:24:28.265523 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ea9044-9879-498c-bd34-fbd5a7a2d247 req-f70f715f-faff-40e2-911b-ff7c3d508858 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:28.269697 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-59ea9044-9879-498c-bd34-fbd5a7a2d247 req-f70f715f-faff-40e2-911b-ff7c3d508858 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0750179 Nov 11 14:24:28.336173 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-59ea9044-9879-498c-bd34-fbd5a7a2d247 req-09a04ead-1b9f-417d-9647-24ebacb969bd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606833 Nov 11 14:24:29.447981 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb1fcdf-054a-42f4-9ec1-7f940549ca68 req-e446970e-ccea-4f91-8bd9-2ae7f438cc98 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:29.449444 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-feb1fcdf-054a-42f4-9ec1-7f940549ca68 req-e446970e-ccea-4f91-8bd9-2ae7f438cc98 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0482936 Nov 11 14:24:29.496333 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-feb1fcdf-054a-42f4-9ec1-7f940549ca68 req-45d29ee9-132b-4004-82c6-3c7fe90ee05a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408845 Nov 11 14:24:30.618413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e04d710-1538-4399-af2e-551ff271463c req-915d7e21-d66c-4dea-9386-7df169026869 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:30.619970 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6e04d710-1538-4399-af2e-551ff271463c req-915d7e21-d66c-4dea-9386-7df169026869 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0584517 Nov 11 14:24:30.668575 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6e04d710-1538-4399-af2e-551ff271463c req-bccffbfa-8950-49ca-9d1a-c8f684ad2095 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426078 Nov 11 14:24:31.782699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-858be139-2c1d-4b77-9ec1-c6380b71f86f req-d2002850-c2f1-44ed-8b1b-f8551cbbd8d2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:31.784162 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-858be139-2c1d-4b77-9ec1-c6380b71f86f req-d2002850-c2f1-44ed-8b1b-f8551cbbd8d2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0476661 Nov 11 14:24:31.829636 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-858be139-2c1d-4b77-9ec1-c6380b71f86f req-b3d48cf2-d2d4-4b6f-a1d4-e38b43b33ed2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397398 Nov 11 14:24:32.980169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5229a02-bdfd-47c5-8a8d-1b44c570f506 req-cf3bca3a-7297-4b4d-9ec0-a92bed962efb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:32.981835 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d5229a02-bdfd-47c5-8a8d-1b44c570f506 req-cf3bca3a-7297-4b4d-9ec0-a92bed962efb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0685813 Nov 11 14:24:33.035795 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d5229a02-bdfd-47c5-8a8d-1b44c570f506 req-d91df00a-5b52-422a-8954-420e6e833e9b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475485 Nov 11 14:24:33.543974 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59656) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:33.646543 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c250ac9-e181-48c6-91e9-8dba64f80672 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:33.720683 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c250ac9-e181-48c6-91e9-8dba64f80672 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:33.822230 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c250ac9-e181-48c6-91e9-8dba64f80672 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:33.864521 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9c250ac9-e181-48c6-91e9-8dba64f80672 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=02c48783adf34a41999c9d52aa8a99d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3194540 Nov 11 14:24:33.865333 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c250ac9-e181-48c6-91e9-8dba64f80672 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9186c8ae-4cf3-4804-adda-b6c396941551,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:33.867383 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59660) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:33.915719 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:33.938819 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:34.084769 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:34.087353 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:34.090886 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/9186c8ae-4cf3-4804-adda-b6c396941551 HTTP/1.1" status: 204 len: 168 time: 0.2201428 Nov 11 14:24:34.112140 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9186c8ae-4cf3-4804-adda-b6c396941551,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:34.124546 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.125121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.125629 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.126129 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.126640 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.127143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.127673 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.128179 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.128685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.129184 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.130840 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.131387 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcda4d9-cb37-4ab9-b991-6562938b533b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:34.208001 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf1c738-0785-406a-9a67-1ee0436e1f17 req-d93ea4e4-f01d-4e33-9044-c85dd74d0f38 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:34.215086 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ecf1c738-0785-406a-9a67-1ee0436e1f17 req-d93ea4e4-f01d-4e33-9044-c85dd74d0f38 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0903442 Nov 11 14:24:34.264408 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ecf1c738-0785-406a-9a67-1ee0436e1f17 req-14abfbba-6e0e-4b16-986f-4dfd5d67d6b5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484178 Nov 11 14:24:35.394678 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf96a8a-ff7f-401b-ba4e-5e2e2a254b93 req-e8d20718-8b47-4b95-9b3a-955cae9cd145 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:35.396869 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7cf96a8a-ff7f-401b-ba4e-5e2e2a254b93 req-e8d20718-8b47-4b95-9b3a-955cae9cd145 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0500448 Nov 11 14:24:35.446212 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7cf96a8a-ff7f-401b-ba4e-5e2e2a254b93 req-e26b3722-7514-4569-9f81-c0b12ed07109 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431962 Nov 11 14:24:36.010585 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-54e4b7e0-8445-4b4f-8358-237cdf313512 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:36.598144 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d0e6a1-d71b-42c2-9932-717f123b47db req-8e71df73-efe0-4239-bcf2-a3092a0b1570 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:36.600367 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-25d0e6a1-d71b-42c2-9932-717f123b47db req-8e71df73-efe0-4239-bcf2-a3092a0b1570 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0839069 Nov 11 14:24:36.658125 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-25d0e6a1-d71b-42c2-9932-717f123b47db req-fadd0639-4730-42f3-8a49-e0c5eba5afaf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501854 Nov 11 14:24:36.981868 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59816) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:37.080921 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9badbb97-0feb-49db-b7d9-ef9d55415dfa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.152649 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9badbb97-0feb-49db-b7d9-ef9d55415dfa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.221745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9badbb97-0feb-49db-b7d9-ef9d55415dfa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.258466 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9badbb97-0feb-49db-b7d9-ef9d55415dfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6799517e-95eb-490c-acff-5af12b7c8d25,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:37.263246 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9badbb97-0feb-49db-b7d9-ef9d55415dfa admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=b0181cbe3a244aa7be5ceec137f1fe7e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2798235 Nov 11 14:24:37.266750 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59820) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:37.314246 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.335242 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.455990 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.458636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:37.459881 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/6799517e-95eb-490c-acff-5af12b7c8d25 HTTP/1.1" status: 204 len: 168 time: 0.1936634 Nov 11 14:24:37.467529 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc135db9-b09a-4ebc-957d-04b7482fdf60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6799517e-95eb-490c-acff-5af12b7c8d25,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:37.791353 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ef1445-bf87-4700-8e34-11ac52f72e3c req-4b806cc2-6540-4b76-b241-912058fb83f7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:37.792856 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-11ef1445-bf87-4700-8e34-11ac52f72e3c req-4b806cc2-6540-4b76-b241-912058fb83f7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0606225 Nov 11 14:24:37.839819 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-11ef1445-bf87-4700-8e34-11ac52f72e3c req-c5717883-7d9a-4ddf-9379-8ec174487e7a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410559 Nov 11 14:24:38.095842 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59842) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:38.109207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b35cfa4b-5035-4331-b90f-9f0b0e06c79b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.179605 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b35cfa4b-5035-4331-b90f-9f0b0e06c79b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.261645 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b35cfa4b-5035-4331-b90f-9f0b0e06c79b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.300685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b35cfa4b-5035-4331-b90f-9f0b0e06c79b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e383652-39a6-4eb9-9910-13c294509663,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:38.304909 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b35cfa4b-5035-4331-b90f-9f0b0e06c79b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=cf12d7c838b74e2abe5396776adc214e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2079577 Nov 11 14:24:38.308200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59844) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:38.354273 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.375056 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.427842 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-674818bc-3ae3-4664-a3a2-2a1c3caccbcf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.472705 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.475281 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:38.476415 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/9e383652-39a6-4eb9-9910-13c294509663 HTTP/1.1" status: 204 len: 168 time: 0.1677725 Nov 11 14:24:38.484248 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194ecb1a-15e9-4973-b9fb-08bc8f6f7674 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e383652-39a6-4eb9-9910-13c294509663,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:38.955674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6454d0-f358-4194-a2c7-789e650fc8b6 req-8aee9655-a5f4-4c6f-add9-0c65d8d5a8e3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:38.957102 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba6454d0-f358-4194-a2c7-789e650fc8b6 req-8aee9655-a5f4-4c6f-add9-0c65d8d5a8e3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0516768 Nov 11 14:24:39.002786 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba6454d0-f358-4194-a2c7-789e650fc8b6 req-e1e2ab10-2526-45d9-bd8b-643dfadc5d7a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398517 Nov 11 14:24:39.145361 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 59866) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:39.158227 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.227511 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.301389 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.340632 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=dc41811269074be198fdc50124046204&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1942077 Nov 11 14:24:39.341459 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d058866-595b-472d-8b5d-ab0038f0508d,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:39.343356 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 59868) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:39.349390 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.349781 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.350124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.350447 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.350775 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.351096 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.351454 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.351849 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.352176 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.352545 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.352865 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.353169 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df839c88-54b0-4e8d-9a44-c59fcb60c826 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:39.355342 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:24:39.392413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.414095 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.518850 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.522271 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:39.524400 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/5d058866-595b-472d-8b5d-ab0038f0508d HTTP/1.1" status: 204 len: 168 time: 0.1798215 Nov 11 14:24:39.536618 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a609c46-a841-478e-8888-46059981bedb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d058866-595b-472d-8b5d-ab0038f0508d,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:39.633491 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:40.125695 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de3f388-63cc-4339-bde6-69ad42ae5b3a req-b3d3c1d0-27e8-45b4-be3d-cc8944c20cfd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:40.127191 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4de3f388-63cc-4339-bde6-69ad42ae5b3a req-b3d3c1d0-27e8-45b4-be3d-cc8944c20cfd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0542295 Nov 11 14:24:40.176672 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4de3f388-63cc-4339-bde6-69ad42ae5b3a req-62c4fc2a-f639-4bfb-ab0a-65fe256f731c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426841 Nov 11 14:24:40.705369 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:41.296554 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5a9fec-241b-4e71-a0ab-9f5d0df1153d req-2b29e9d6-9b92-4625-9d2e-5e2a7127bb2d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:41.298134 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7b5a9fec-241b-4e71-a0ab-9f5d0df1153d req-2b29e9d6-9b92-4625-9d2e-5e2a7127bb2d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0550671 Nov 11 14:24:41.349044 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7b5a9fec-241b-4e71-a0ab-9f5d0df1153d req-8fee4aa9-8655-4d2b-974a-91ee45a558ff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427980 Nov 11 14:24:41.680119 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:42.010372 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:42.481830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebcc2ac0-d9fa-4325-9a40-344a98279f32 req-67596dc0-7627-4525-8311-3b333577e672 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:42.483308 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebcc2ac0-d9fa-4325-9a40-344a98279f32 req-67596dc0-7627-4525-8311-3b333577e672 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0539577 Nov 11 14:24:42.530221 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebcc2ac0-d9fa-4325-9a40-344a98279f32 req-ba87ea16-737c-48f7-9a13-d0f0e4519493 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410233 Nov 11 14:24:43.107589 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60012) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:43.206297 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-11ad7a2a-9a2c-4b86-bc1a-43c7543480f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.287084 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-11ad7a2a-9a2c-4b86-bc1a-43c7543480f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.398833 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-11ad7a2a-9a2c-4b86-bc1a-43c7543480f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.436850 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-11ad7a2a-9a2c-4b86-bc1a-43c7543480f7 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c477067e21a44921a8901ef5adce9954&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3281286 Nov 11 14:24:43.437478 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ad7a2a-9a2c-4b86-bc1a-43c7543480f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95ce8a70-9e60-45aa-878d-a9348b43bd12,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:43.439456 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60018) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:43.488130 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.508925 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.605838 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.608576 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:43.609638 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/95ce8a70-9e60-45aa-878d-a9348b43bd12 HTTP/1.1" status: 204 len: 168 time: 0.1691859 Nov 11 14:24:43.634276 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7756e72f-10a0-41c1-97c1-665e22db518c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95ce8a70-9e60-45aa-878d-a9348b43bd12,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:43.654619 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce78697a-5fdd-4014-8e52-d617843ff650 req-14ed0b6a-9731-47ef-a597-edab814a188e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:43.656546 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ce78697a-5fdd-4014-8e52-d617843ff650 req-14ed0b6a-9731-47ef-a597-edab814a188e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0606592 Nov 11 14:24:43.714375 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ce78697a-5fdd-4014-8e52-d617843ff650 req-0f925888-1791-4a9f-8332-1181af6ae8c7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517919 Nov 11 14:24:44.250335 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60060) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:44.264378 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-57d35c8a-ffec-4f81-abbd-c9786219fea1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.355800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-57d35c8a-ffec-4f81-abbd-c9786219fea1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.444717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-57d35c8a-ffec-4f81-abbd-c9786219fea1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.501563 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-57d35c8a-ffec-4f81-abbd-c9786219fea1 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5e337257f5dd4f679bf142ef0e7d3631&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2492228 Nov 11 14:24:44.501693 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d35c8a-ffec-4f81-abbd-c9786219fea1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5297b43e-94c2-4a2b-ad4c-50f33edc1789,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:44.508415 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60082) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:44.567476 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.588693 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.666088 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-0fcc250e-e330-4347-9167-547ef1329799 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0400586 Nov 11 14:24:44.724661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.728667 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:44.740229 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/5297b43e-94c2-4a2b-ad4c-50f33edc1789 HTTP/1.1" status: 204 len: 168 time: 0.2219336 Nov 11 14:24:44.749441 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0d9a98-9d93-48f8-84b0-e90d6ad152b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5297b43e-94c2-4a2b-ad4c-50f33edc1789,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:44.783090 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-d3d457fd-be10-453d-93e6-a7f3e74bc16a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:44.785161 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-d3d457fd-be10-453d-93e6-a7f3e74bc16a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=bdc0ecb12a544f42ac73824cb88fff50&device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 1098 time: 0.0656664 Nov 11 14:24:44.951180 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3ef16d-f6a7-46fe-80d1-709fd6878f30 req-4db3316d-9d80-4468-be2b-f4896ade7ad6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:44.952723 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0d3ef16d-f6a7-46fe-80d1-709fd6878f30 req-4db3316d-9d80-4468-be2b-f4896ade7ad6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.1015785 Nov 11 14:24:44.955777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-d24d19de-ca11-4e95-abed-85d1c1252e35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:44.957147 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-d24d19de-ca11-4e95-abed-85d1c1252e35 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c5b58dcb-77a0-4901-9126-308811d4244f HTTP/1.1" status: 200 len: 913 time: 0.1447320 Nov 11 14:24:45.013482 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-40ed76eb-07fc-4618-bf8b-3c34df6ad669 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 HTTP/1.1" status: 200 len: 217 time: 0.0445263 Nov 11 14:24:45.019059 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60098) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:45.095778 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0d3ef16d-f6a7-46fe-80d1-709fd6878f30 req-e38f2fc8-41ac-4aa1-9f6d-f08c0eb1d331 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1316078 Nov 11 14:24:45.105850 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-5b5c3785-e4d4-4476-8cb6-d80b68d7804a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:45.108405 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-5b5c3785-e4d4-4476-8cb6-d80b68d7804a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=f61b21b8-9633-4547-a15b-20ec2c3f175f HTTP/1.1" status: 200 len: 852 time: 0.0868824 Nov 11 14:24:45.162121 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-8eae31f4-5986-4069-b6ce-0be9784927f0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c5b58dcb-77a0-4901-9126-308811d4244f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0295916 Nov 11 14:24:45.298769 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-fd88e113-b390-45e5-b8d0-fb79c376802e service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1287067 Nov 11 14:24:45.350465 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad1c2e00-1ced-46d5-87f7-e8f4f1af9fe2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.424570 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d40bc573-e3bd-4bc4-9410-8b12ca9a4d6a req-0b7f0631-dee1-4c1d-8c88-d6c49133ba6a service neutron] 10.222.0.11 "GET /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1144044 Nov 11 14:24:45.443488 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad1c2e00-1ced-46d5-87f7-e8f4f1af9fe2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.571166 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ad1c2e00-1ced-46d5-87f7-e8f4f1af9fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.611475 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ad1c2e00-1ced-46d5-87f7-e8f4f1af9fe2 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=4b8ba7b30a484f1488b8c97e1ca7fce3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5908549 Nov 11 14:24:45.613335 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1c2e00-1ced-46d5-87f7-e8f4f1af9fe2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28be38df-572e-4493-9fac-613f8955ed80,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:45.614164 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60132) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:45.668580 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.697411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.813968 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.816706 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:45.817910 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/28be38df-572e-4493-9fac-613f8955ed80 HTTP/1.1" status: 204 len: 168 time: 0.2027693 Nov 11 14:24:45.846956 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af52dd8c-0c56-4c12-81b8-7b6e515e1b0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28be38df-572e-4493-9fac-613f8955ed80,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:45.875322 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ba8da8-081e-421a-afca-2be42805ede6 req-a4f23e7c-be88-4df6-98b6-97c4b00f6087 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:45.878101 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-74ba8da8-081e-421a-afca-2be42805ede6 req-a4f23e7c-be88-4df6-98b6-97c4b00f6087 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0654075 Nov 11 14:24:45.934604 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-74ba8da8-081e-421a-afca-2be42805ede6 req-e4705361-7e91-4c8d-8fb4-b5544d0a0115 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461435 Nov 11 14:24:46.217531 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0508332d-874e-4e73-8a8e-901d13a37124 req-ab70cc23-a6b8-44c6-95a9-7aaeea1ace16 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:46.219051 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0508332d-874e-4e73-8a8e-901d13a37124 req-ab70cc23-a6b8-44c6-95a9-7aaeea1ace16 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0572248 Nov 11 14:24:46.269289 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0508332d-874e-4e73-8a8e-901d13a37124 req-5707b418-f0c2-4a58-9397-e32d847cfb94 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433090 Nov 11 14:24:47.085459 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46862a7-e992-4b4a-8333-b8524459adc2 req-f06104a2-2e6a-437b-999d-44d2e48bcfa7 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:47.086956 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f46862a7-e992-4b4a-8333-b8524459adc2 req-f06104a2-2e6a-437b-999d-44d2e48bcfa7 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0678353 Nov 11 14:24:47.156805 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f46862a7-e992-4b4a-8333-b8524459adc2 req-a72d2fd2-44f2-4a18-812b-e1d3c6207463 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625453 Nov 11 14:24:47.408100 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b568fb-6c80-4215-b9ba-5009fb482292 req-5a79249a-4982-4146-90df-f8a3fbf82ecd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:47.409741 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d3b568fb-6c80-4215-b9ba-5009fb482292 req-5a79249a-4982-4146-90df-f8a3fbf82ecd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0517766 Nov 11 14:24:47.463732 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d3b568fb-6c80-4215-b9ba-5009fb482292 req-d05cf3db-1248-469f-8335-e834b1dfb7f7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476077 Nov 11 14:24:47.864490 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-72f68b89-75e9-4e9a-8cf2-12464abf7ff8 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:47.866370 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-72f68b89-75e9-4e9a-8cf2-12464abf7ff8 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.11 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0539308 Nov 11 14:24:48.042109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Deleting port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:24:48.042443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:48.325004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7ba741-4240-46f1-a0fd-10262d4b3333 req-a09202d7-ec10-417d-b94a-c84c927a0312 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:48.326463 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-be7ba741-4240-46f1-a0fd-10262d4b3333 req-a09202d7-ec10-417d-b94a-c84c927a0312 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 945 time: 0.0696187 Nov 11 14:24:48.341861 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] For port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,segment=NetworkSegment(1f5a608b-b556-45dc-b01f-3b9432671af9),segment_id=1f5a608b-b556-45dc-b01f-3b9432671af9)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:48.342134 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:48.370039 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Calling delete_port for 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:24:48.459344 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-be7ba741-4240-46f1-a0fd-10262d4b3333 req-0129c2db-863b-4ce9-b9be-ea381ed01050 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/security-groups?id=c2825989-7d0d-4b94-8503-d93685f9337d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1251247 Nov 11 14:24:48.588256 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece9ab4d-e271-4611-9cce-3dbdb355a856 req-8774eb26-edfb-4f82-b8e5-0233380f37a8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:48.589760 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ece9ab4d-e271-4611-9cce-3dbdb355a856 req-8774eb26-edfb-4f82-b8e5-0233380f37a8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0529606 Nov 11 14:24:48.638940 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:48.640485 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ece9ab4d-e271-4611-9cce-3dbdb355a856 req-4f117f0b-0bde-4fc3-9742-88c5a270610a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442739 Nov 11 14:24:48.651436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:24:48.674781 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Pushing event deleted for resources: {'Port': ['ID=801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:48.764690 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] No DVR routers for this DVR port 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:24:48.768428 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:48.772325 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ffd7350b-5847-4f6a-a7da-37435d2cf74d req-c8d0e106-0e9c-494c-afe9-e0734964d944 tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.11 "DELETE /v2.0/ports/801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 HTTP/1.1" status: 204 len: 173 time: 0.8967271 Nov 11 14:24:48.772785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'name': 'network-vif-deleted', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:24:48.775520 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-adbd6665-e07a-4954-8a40-1692547f7360" -d '{"events": [{"server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "name": "network-vif-deleted", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:24:48.814678 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:24:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-320da015-5b95-48ee-b44f-10f8419bf70b x-openstack-request-id: req-320da015-5b95-48ee-b44f-10f8419bf70b {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:24:48.814970 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "404bf741-317c-4b8c-8566-9ef7c74d7917", "name": "network-vif-deleted", "tag": "801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:24:48.815219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-320da015-5b95-48ee-b44f-10f8419bf70b {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:24:48.815648 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '404bf741-317c-4b8c-8566-9ef7c74d7917', 'name': 'network-vif-deleted', 'tag': '801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74', 'status': 'completed', 'code': 200} Nov 11 14:24:49.013724 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60290) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:49.088502 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60296) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:49.173542 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-758ce529-9297-41f2-a4b8-547db86a9ca2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.203122 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a7ab5428-4aaa-4fca-ad28-cf625a176d86 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.315207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-758ce529-9297-41f2-a4b8-547db86a9ca2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.337421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a7ab5428-4aaa-4fca-ad28-cf625a176d86 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.407699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-758ce529-9297-41f2-a4b8-547db86a9ca2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.441404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a7ab5428-4aaa-4fca-ad28-cf625a176d86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.446219 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-758ce529-9297-41f2-a4b8-547db86a9ca2 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c6eb2513440141f0a929ad9b0da2638e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4315038 Nov 11 14:24:49.448028 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758ce529-9297-41f2-a4b8-547db86a9ca2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13ab382a-fb4a-4cc7-8ed3-f2b1e3fb52b2,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:49.449608 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60312) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:49.482899 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a7ab5428-4aaa-4fca-ad28-cf625a176d86 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=70f48e4fb14d42cfbe51763ef0002ce3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3932061 Nov 11 14:24:49.486190 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60314) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:49.492003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ab5428-4aaa-4fca-ad28-cf625a176d86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27de27b3-19af-4f4b-a96d-41762ed2ba0f,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:49.533964 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.567046 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.588133 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.609355 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9b824f42-fb10-437a-9d0f-e0769fcadca0 req-39b63969-4a7f-460a-937c-a2ce9aadf9fa tempest-DeleteServersTestJSON-1631314517 tempest-DeleteServersTestJSON-1631314517-project] 10.222.0.10 "GET /v2.0/ports?device_id=404bf741-317c-4b8c-8566-9ef7c74d7917 HTTP/1.1" status: 200 len: 210 time: 0.0443606 Nov 11 14:24:49.640516 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.764222 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ca93cb-00ea-4dcf-bf79-7c934380f0de req-739c19d1-57b6-4210-9774-ac1dcd7cefcd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:49.764464 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.765728 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f9ca93cb-00ea-4dcf-bf79-7c934380f0de req-739c19d1-57b6-4210-9774-ac1dcd7cefcd tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0495777 Nov 11 14:24:49.767469 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.768678 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/13ab382a-fb4a-4cc7-8ed3-f2b1e3fb52b2 HTTP/1.1" status: 204 len: 168 time: 0.3180439 Nov 11 14:24:49.776929 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97dcdcb-854f-46be-9617-fe04683848bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13ab382a-fb4a-4cc7-8ed3-f2b1e3fb52b2,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:49.801093 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.804886 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:49.808744 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/27de27b3-19af-4f4b-a96d-41762ed2ba0f HTTP/1.1" status: 204 len: 168 time: 0.3216140 Nov 11 14:24:49.819739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85d5904-9190-4a75-bb69-27a2f8b1c54a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27de27b3-19af-4f4b-a96d-41762ed2ba0f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:49.832166 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f9ca93cb-00ea-4dcf-bf79-7c934380f0de req-070610ef-a279-4ae3-896d-e994ed94d413 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595953 Nov 11 14:24:50.565454 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60340) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:50.579316 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-969ae366-6293-4e47-8c91-a0cc39aa5783 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.665646 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-969ae366-6293-4e47-8c91-a0cc39aa5783 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.672664 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60344) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:50.686969 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f25e1ab1-386e-4208-85ab-4a26abe8fb88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.742344 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-969ae366-6293-4e47-8c91-a0cc39aa5783 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.793245 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-969ae366-6293-4e47-8c91-a0cc39aa5783 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5af6dcf1b7fb4cef93ce749981d1f23a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2266953 Nov 11 14:24:50.797421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60356) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:50.810318 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969ae366-6293-4e47-8c91-a0cc39aa5783 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e57a8043-9b10-4598-ae13-63d373480cb6,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:50.832296 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f25e1ab1-386e-4208-85ab-4a26abe8fb88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.889374 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.897154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f25e1ab1-386e-4208-85ab-4a26abe8fb88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.928922 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:50.991480 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f25e1ab1-386e-4208-85ab-4a26abe8fb88 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=db725407c5af41d592d47c76a08e2396&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3162873 Nov 11 14:24:50.992122 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25e1ab1-386e-4208-85ab-4a26abe8fb88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76799a40-7953-4efc-8910-f882bd227902,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:50.994363 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60366) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:51.014420 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f169094-2158-4a07-8f8d-6150ed449758 req-28a7ca02-d896-4166-99d1-a294881b3503 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:51.016012 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7f169094-2158-4a07-8f8d-6150ed449758 req-28a7ca02-d896-4166-99d1-a294881b3503 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0786550 Nov 11 14:24:51.057635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60368) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:51.058567 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.082948 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.083919 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7f169094-2158-4a07-8f8d-6150ed449758 req-e5baa4dc-51c6-47bf-bb17-da46219ea7a8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618293 Nov 11 14:24:51.091996 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.094616 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.095849 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/e57a8043-9b10-4598-ae13-63d373480cb6 HTTP/1.1" status: 204 len: 168 time: 0.2974391 Nov 11 14:24:51.121487 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c204375-0306-43a3-b2f8-6ad6ee5fe358 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e57a8043-9b10-4598-ae13-63d373480cb6,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:51.179164 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d0822aa6-5f09-468a-86f2-6a4f4ee108e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.290886 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.301758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.302717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/76799a40-7953-4efc-8910-f882bd227902 HTTP/1.1" status: 204 len: 168 time: 0.3072383 Nov 11 14:24:51.321368 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee74325-6d3a-4635-b499-c43d88c9c3d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76799a40-7953-4efc-8910-f882bd227902,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:51.370798 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d0822aa6-5f09-468a-86f2-6a4f4ee108e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.386370 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60384) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:51.460616 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d0822aa6-5f09-468a-86f2-6a4f4ee108e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.504204 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d0822aa6-5f09-468a-86f2-6a4f4ee108e1 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=f9195b1b7ee94ed59cd374e61e74a771&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4429879 Nov 11 14:24:51.504204 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0822aa6-5f09-468a-86f2-6a4f4ee108e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f58d138-e041-4ac9-9924-417aa5d15abd,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:51.505221 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60394) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:51.557481 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.586382 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:24:51.586942 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-33364734-c2d2-4a7b-b8b1-0b24c6fc3a77 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.590058 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.605425 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:24:51.605849 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 801dd0de-4b5c-4d51-bbb9-4b2ad85f6e74 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:24:51.771119 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.774517 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.784699 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/5f58d138-e041-4ac9-9924-417aa5d15abd HTTP/1.1" status: 204 len: 168 time: 0.2734854 Nov 11 14:24:51.793433 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449faaa6-90d4-46e6-b512-42cd9dc085ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f58d138-e041-4ac9-9924-417aa5d15abd,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:51.833026 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-33364734-c2d2-4a7b-b8b1-0b24c6fc3a77 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.941700 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-33364734-c2d2-4a7b-b8b1-0b24c6fc3a77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:51.983198 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-33364734-c2d2-4a7b-b8b1-0b24c6fc3a77 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=f5b23a0eaf2a4d37b1cf5fe68403669a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5952334 Nov 11 14:24:51.983986 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33364734-c2d2-4a7b-b8b1-0b24c6fc3a77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbcef0af-d695-456b-8b47-5748a7f5739b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:51.986004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60414) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:52.036394 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.065757 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.222488 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db92e08-bb1c-4ed7-baa6-0004d0779206 req-e27ddd33-9c94-4ca5-b608-12033bb97d80 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:52.224199 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3db92e08-bb1c-4ed7-baa6-0004d0779206 req-e27ddd33-9c94-4ca5-b608-12033bb97d80 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0506361 Nov 11 14:24:52.239167 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.243177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.243177 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/fbcef0af-d695-456b-8b47-5748a7f5739b HTTP/1.1" status: 204 len: 168 time: 0.2559454 Nov 11 14:24:52.262626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f003741-d62c-4dea-801f-7cb470b758fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbcef0af-d695-456b-8b47-5748a7f5739b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:52.293983 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3db92e08-bb1c-4ed7-baa6-0004d0779206 req-6337f2bb-1591-4a40-9c11-9b6172a557a5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630012 Nov 11 14:24:52.331626 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60438) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:52.395752 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Deleting subnet f61b21b8-9633-4547-a15b-20ec2c3f175f {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:24:52.400204 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.411531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cdd28a8-ded3-48e3-bd87-26b84f10c13e req-82380199-d3b3-4307-87cd-aefe17da6c01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:52.413139 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9cdd28a8-ded3-48e3-bd87-26b84f10c13e req-82380199-d3b3-4307-87cd-aefe17da6c01 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 1098 time: 0.0532515 Nov 11 14:24:52.438823 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.448947 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.470768 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9cdd28a8-ded3-48e3-bd87-26b84f10c13e req-e2e2370b-bb2b-4631-8dc9-83bf61bc40d8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489767 Nov 11 14:24:52.508085 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60444) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:52.521317 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c93aed9-2d84-4db4-84ba-4f7b76356010 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.622000 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c93aed9-2d84-4db4-84ba-4f7b76356010 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.628150 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.655935 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f61b21b8-9633-4547-a15b-20ec2c3f175f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:52.659540 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.662805 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-27ada23d-61bf-4b49-9b70-a09d94c78315 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/f61b21b8-9633-4547-a15b-20ec2c3f175f HTTP/1.1" status: 204 len: 168 time: 0.3300858 Nov 11 14:24:52.665500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60454) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:52.729539 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c93aed9-2d84-4db4-84ba-4f7b76356010 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.753472 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.789214 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1c93aed9-2d84-4db4-84ba-4f7b76356010 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d9f522145ec248e08c5d1137724896f7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2779319 Nov 11 14:24:52.789855 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60460) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:52.791197 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c93aed9-2d84-4db4-84ba-4f7b76356010 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01507998-cf32-4fcf-8752-032c44298279,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:52.858552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.882855 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.892865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:52.920082 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.920760 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.921523 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.921854 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > port after_create 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.922166 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > port after_delete 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.922500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > port after_update 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.922812 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.923104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.923562 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:52.923887 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:53.010561 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.016035 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.016035 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/01507998-cf32-4fcf-8752-032c44298279 HTTP/1.1" status: 204 len: 168 time: 0.2237129 Nov 11 14:24:53.022402 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c18967-b54e-486e-9135-1ed5d85df2fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01507998-cf32-4fcf-8752-032c44298279,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:53.083565 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:53.084250 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:53.084395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:53.084773 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102267) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:24:53.085121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5b58dcb-77a0-4901-9126-308811d4244f']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:24:53.106181 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1f5a608b-b556-45dc-b01f-3b9432671af9') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:24:53.106470 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1f5a608b-b556-45dc-b01f-3b9432671af9') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:24:53.134840 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.156816 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.164918 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Releasing vlan 332 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:24:53.165285 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: from cryptography.utils import int_from_bytes Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: from cryptography.utils import int_from_bytes Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:24:53.197868 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:24:53.404484 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.420061 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8031bd8a-5952-40a8-8aec-4a61c6e96f82 req-64e4e709-c4d6-472e-ad10-65563d8928a5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:53.421724 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8031bd8a-5952-40a8-8aec-4a61c6e96f82 req-64e4e709-c4d6-472e-ad10-65563d8928a5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0593326 Nov 11 14:24:53.427236 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:53.437428 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] 10.222.0.10 "DELETE /v2.0/networks/c5b58dcb-77a0-4901-9126-308811d4244f HTTP/1.1" status: 204 len: 168 time: 0.7684932 Nov 11 14:24:53.452944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f370d1d-431d-4cc6-b5b1-9610246e6f6d admin admin] Pushing event deleted for resources: {'Network': ['ID=c5b58dcb-77a0-4901-9126-308811d4244f,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:53.490954 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8031bd8a-5952-40a8-8aec-4a61c6e96f82 req-2c2c8f7b-ea04-4996-945d-9eff6b63ec53 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436563 Nov 11 14:24:54.107770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60506) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:54.149369 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ccbd2496-1b09-471c-9a81-f6452f3117a5 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=bdc0ecb12a544f42ac73824cb88fff50&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0404625 Nov 11 14:24:54.152221 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60510) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:54.207437 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:54.230231 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:54.381605 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:54.385813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:54.389542 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/c2825989-7d0d-4b94-8503-d93685f9337d HTTP/1.1" status: 204 len: 168 time: 0.2337716 Nov 11 14:24:54.396727 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20ee8b6-2226-418e-843b-af4458ec46e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2825989-7d0d-4b94-8503-d93685f9337d,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:54.614687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f2a2fc0-95e4-4634-a002-1036f3a4cb64 req-8300c684-b348-4a0e-b770-bd7c0caf2c59 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:54.617517 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f2a2fc0-95e4-4634-a002-1036f3a4cb64 req-8300c684-b348-4a0e-b770-bd7c0caf2c59 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0572217 Nov 11 14:24:54.667573 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f2a2fc0-95e4-4634-a002-1036f3a4cb64 req-e4ad9588-9115-417a-8890-2a485bf3c47d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427668 Nov 11 14:24:54.801304 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b50b5f-eefa-4a96-a62e-087690dc294a req-43d155ae-e0b1-4eb2-9aad-95c8a95c1f79 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:54.802934 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-64b50b5f-eefa-4a96-a62e-087690dc294a req-43d155ae-e0b1-4eb2-9aad-95c8a95c1f79 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0529137 Nov 11 14:24:54.858906 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-64b50b5f-eefa-4a96-a62e-087690dc294a req-ee0703a8-c2c9-40bc-af4c-e9790f039e85 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496242 Nov 11 14:24:55.036027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60552) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:55.320135 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-975802405-network', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:55.421798 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Made reservation on behalf of 2d09ad6536ff49c4b4e43c8239742bc5 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:24:55.424082 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.434169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.551934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.613962 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.650101 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 329} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:24:55.666791 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3acf3dcc-29e9-4219-9c33-ff5d63e00e1c,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:55.671223 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.671598 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Added segment da028d45-e079-4155-9323-70c10aaac9cf of type vlan for network 4bad907f-fd8e-4849-9ded-63b7501aff2a Nov 11 14:24:55.721802 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.831288 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.833159 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:55.833915 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:55.924118 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8868313 Nov 11 14:24:55.927011 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60598) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:55.932478 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Request body: {'subnet': {'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-975802405-subnet', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:55.941709 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda43236-d7fa-4dfd-8bc5-062eb25c1d61 admin admin] Pushing event updated for resources: {'Network': ['ID=4bad907f-fd8e-4849-9ded-63b7501aff2a,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:55.952549 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:24:56.050632 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Made reservation on behalf of 2d09ad6536ff49c4b4e43c8239742bc5 for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:24:56.053840 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Publish callbacks [] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.319436 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.393518 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Pushing event updated for resources: {'Subnet': ['ID=2b677022-3ca7-40d0-ba96-f88e6df9c517,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:56.403294 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:24:56.403674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Network hostable DHCP agents. Network: 4bad907f-fd8e-4849-9ded-63b7501aff2a, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:24:56.530449 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:24:56.577194 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60622) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:56.616220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 4bad907f-fd8e-4849-9ded-63b7501aff2a) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:24:56.620496 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:56.621107 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.628084 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19c39f7e-3771-4969-8955-839068a42f6e None None] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:24:56.688556 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-87358732-6506-44ed-87d2-421b21eb319c admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7602460 Nov 11 14:24:56.691060 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60630) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:56.695622 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:56.723028 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-network', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:56.824042 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.825403 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.825599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-4bad907f-fd8e-4849-9ded-63b7501aff2a', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:24:56.829208 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.899858 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.930705 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Made reservation on behalf of b69e80bc4d824db9a0104c514f7dc8fa for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:24:56.932980 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:56.941681 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.053838 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Allocated IP 172.20.0.2 (4bad907f-fd8e-4849-9ded-63b7501aff2a/2b677022-3ca7-40d0-ba96-f88e6df9c517/3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:24:57.268405 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.358575 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.398998 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.403027 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.430843 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:24:57.435053 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:24:57.437059 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Pushing event updated for resources: {'Port': ['ID=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:57.444931 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:24:57.447705 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.448053 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.448393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.448903 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.449171 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.449503 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.449827 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.450149 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.450492 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.450819 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.451137 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.451474 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:24:57.501740 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.516131 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Attempting to bind port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:24:57.516496 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Attempting to bind port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:24:57.516850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Attempting to bind port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:24:57.522447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:24:57.523063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:24:57.523647 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.524471 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Bound using segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:24:57.525099 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Bound port: 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:24:57.525503 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.537929 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 301} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:24:57.548024 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=775d6914-66ff-45f9-bfc6-5976ee5f6450,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:57.555778 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.556196 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Added segment 71ca5e77-82e8-4016-9192-b9657483c90f of type vlan for network c68a47ca-25f9-4130-912b-bec65a17b2f1 Nov 11 14:24:57.641229 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] For port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:24:57.646610 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] For port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:24:57.656990 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.790146 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b058ace9-cdef-4953-b16b-405bdf57d6a0 req-e30b03c8-0b85-4214-8a25-c02d0e21ed44 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:57.790146 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b058ace9-cdef-4953-b16b-405bdf57d6a0 req-e30b03c8-0b85-4214-8a25-c02d0e21ed44 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0532618 Nov 11 14:24:57.790146 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b058ace9-cdef-4953-b16b-405bdf57d6a0 req-b9e2829d-5655-4194-9e3f-0cd72290dbc5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474908 Nov 11 14:24:57.881704 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:57.894260 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.003405 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Allocated IP 172.27.1.146 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/b037cf4d-0426-4c96-9e8b-fb99b6d7899f) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:24:58.012538 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-300e8f67-7d30-40cf-8027-9341263d754c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:58.014012 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-300e8f67-7d30-40cf-8027-9341263d754c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.0444040 Nov 11 14:24:58.082320 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.091909 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.092857 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:58.094175 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.109763 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-7a29e457-124b-4ebc-8392-0f060ca8fa9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:58.111463 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-7a29e457-124b-4ebc-8392-0f060ca8fa9f service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.0884264 Nov 11 14:24:58.139509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.173490 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ef17b5-ed60-4347-85a4-9b7aec51151e None None] Pushing event updated for resources: {'Port': ['ID=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:58.180117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] Pushing event updated for resources: {'Network': ['ID=c68a47ca-25f9-4130-912b-bec65a17b2f1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:58.191836 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-161c8922-850f-40ce-8070-93fc9401be65 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.0708194 Nov 11 14:24:58.194565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:24:58.237065 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d843f7cd-bfff-4122-8617-85583ba17b3e admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.6584797 Nov 11 14:24:58.241567 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60682) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:58.250996 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Request body: {'subnet': {'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-subnet', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:58.265384 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-eae6a7b4-5391-44f4-8f96-02db083c66b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:58.268155 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-eae6a7b4-5391-44f4-8f96-02db083c66b8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.0699005 Nov 11 14:24:58.280145 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.316913 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-f1cd1372-3e26-4c2f-ba3f-9b7e21258ebe service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0413504 Nov 11 14:24:58.332609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:24:58.336768 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:24:58.341091 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:24:58.346694 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Pushing event updated for resources: {'Port': ['ID=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:58.392549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Made reservation on behalf of b69e80bc4d824db9a0104c514f7dc8fa for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:24:58.395561 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.452786 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-50985da9-1b61-4bb3-b4e3-c3b4b97839fd service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282415 Nov 11 14:24:58.590319 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85d00935-420d-4e18-bf4d-b6dfaa3c477a req-514d8e7d-4ef1-465c-9ee0-45948c8ded3a service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288567 Nov 11 14:24:58.790200 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.859596 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a758aa63-a5a7-49f1-8370-ad64ffdcb95b,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:24:58.879270 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:58.973126 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Checking segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:24:58.973759 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Network hostable DHCP agents. Network: c68a47ca-25f9-4130-912b-bec65a17b2f1, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:24:59.066708 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0fde9d-3a80-470e-808d-ca977be381cb req-ccca290a-eaaa-48d5-92e8-5d5074af4f80 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:59.069190 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cd0fde9d-3a80-470e-808d-ca977be381cb req-ccca290a-eaaa-48d5-92e8-5d5074af4f80 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1472631 Nov 11 14:24:59.133291 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:24:59.218385 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cd0fde9d-3a80-470e-808d-ca977be381cb req-d46d62e8-e8fd-49a9-a007-de47a5ea1c99 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1412165 Nov 11 14:24:59.219979 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, c68a47ca-25f9-4130-912b-bec65a17b2f1) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:24:59.233554 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:24:59.234128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.237190 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bc9ab89-8adc-49fe-abdd-72f6a8c11b45 None None] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:24:59.244105 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.341640 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-89a03c66-1a15-4b14-b9c0-eb7c656d17a2 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.0986676 Nov 11 14:24:59.344295 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60734) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:24:59.350467 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:24:59.424177 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-c68a47ca-25f9-4130-912b-bec65a17b2f1', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:24:59.425058 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.437958 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-764efa48-9d65-4df9-8969-9b0195445424 None None] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:24:59.503152 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.504305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.576447 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Router 589db83d-340f-42a5-815b-afa42568542b is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:24:59.583549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.591422 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] Provisioning complete for port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:24:59.594130 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.746577 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Allocated IP 172.20.0.2 (c68a47ca-25f9-4130-912b-bec65a17b2f1/a758aa63-a5a7-49f1-8370-ad64ffdcb95b/ef3d283d-240b-4f68-915c-45e8a5de4416) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:24:59.852755 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:24:59.944484 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] For port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:24:59.991928 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:00.039735 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.050329 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.070331 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.087117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:00.099608 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:00.111912 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:00.111912 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:00.121680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:00.122132 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.144920 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.158546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a711992-1d79-43e9-93e8-88cf774e18a5 None None] Pushing event updated for resources: {'Port': ['ID=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:00.207711 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Pushing event updated for resources: {'Port': ['ID=ef3d283d-240b-4f68-915c-45e8a5de4416,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:00.226201 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.226813 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:00.228729 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:00.229040 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2d15db9c-70fb-4b0c-98cf-ccd0c4cef6bd admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.5359206 Nov 11 14:25:00.231408 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60758) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:00.234904 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:00.281495 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60764) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:00.347072 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:00.392049 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-1d141dfd-ab56-4f3d-a451-2537fc46313f None None] Provisioning complete for port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:00.393034 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1d141dfd-ab56-4f3d-a451-2537fc46313f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.444263 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Attempting to bind port ef3d283d-240b-4f68-915c-45e8a5de4416 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:00.444878 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Attempting to bind port ef3d283d-240b-4f68-915c-45e8a5de4416 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:00.445244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Attempting to bind port ef3d283d-240b-4f68-915c-45e8a5de4416 on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:00.457638 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:00.458065 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Checking segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:00.458396 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.458746 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Bound using segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:00.459447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Bound port: ef3d283d-240b-4f68-915c-45e8a5de4416, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:00.459984 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.556108 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.595919 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:24:58Z', 'revision_number': 3, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:24:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:00.607747 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.620957 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b523c5-0e6b-42c1-831e-8e2ba0bf9521 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.648814 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:00.649507 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Updating router 589db83d-340f-42a5-815b-afa42568542b port b037cf4d-0426-4c96-9e8b-fb99b6d7899f binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:00.687838 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.716299 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b294c50-99f8-4e10-a88d-42f2b5fb5674 req-d6e549c2-81f1-4328-a311-9658833dcdf7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:00.721762 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2b294c50-99f8-4e10-a88d-42f2b5fb5674 req-d6e549c2-81f1-4328-a311-9658833dcdf7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.3893564 Nov 11 14:25:00.774385 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Allocated IP 172.27.1.9 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/a2276ac6-774c-4412-884e-d46de32946e4) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:00.824870 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b523c5-0e6b-42c1-831e-8e2ba0bf9521 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.861888 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] For port ef3d283d-240b-4f68-915c-45e8a5de4416, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:00.866514 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] For port ef3d283d-240b-4f68-915c-45e8a5de4416, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ef3d283d-240b-4f68-915c-45e8a5de4416,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:00.932369 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.937301 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:00.946021 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b523c5-0e6b-42c1-831e-8e2ba0bf9521 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.003597 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff040ea5-f1be-4173-bb38-200c1685245e None None] Pushing event updated for resources: {'Port': ['ID=ef3d283d-240b-4f68-915c-45e8a5de4416,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:01.098049 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-42b523c5-0e6b-42c1-831e-8e2ba0bf9521 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=1c8e12879fda4976a71c4360ad51e842&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8084881 Nov 11 14:25:01.098967 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60792) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:01.102602 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b523c5-0e6b-42c1-831e-8e2ba0bf9521 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffc23630-0667-4bd1-82cc-c0ff789e5dfc,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:01.161894 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2b294c50-99f8-4e10-a88d-42f2b5fb5674 req-868a660c-6882-46b4-b704-b6cfeae0b77e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3773544 Nov 11 14:25:01.208739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.244794 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.283948 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.440370 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Pushing event updated for resources: {'Port': ['ID=a2276ac6-774c-4412-884e-d46de32946e4,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:01.446774 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:01.462164 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:01.466749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:01.478875 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.537506 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.645018 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.687682 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60804) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:01.700018 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Attempting to bind port b037cf4d-0426-4c96-9e8b-fb99b6d7899f on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:01.700407 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Attempting to bind port b037cf4d-0426-4c96-9e8b-fb99b6d7899f by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:01.701115 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Attempting to bind port b037cf4d-0426-4c96-9e8b-fb99b6d7899f on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:01.708270 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Pushing event updated for resources: {'Port': ['ID=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:01.712061 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:01.717600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:01.717600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.717600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:01.717600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Bound port: b037cf4d-0426-4c96-9e8b-fb99b6d7899f, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:01.717600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.718111 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.720399 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.724116 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/ffc23630-0667-4bd1-82cc-c0ff789e5dfc HTTP/1.1" status: 204 len: 168 time: 0.5909262 Nov 11 14:25:01.749157 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db70e442-e6bb-4b26-a1b3-56073e794d46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffc23630-0667-4bd1-82cc-c0ff789e5dfc,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:01.750763 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.754277 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.754659 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.755020 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.755354 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.755726 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.756586 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.756924 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.757270 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.757611 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.757939 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.758269 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:01.811920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Allocated IP 172.20.0.1 (4bad907f-fd8e-4849-9ded-63b7501aff2a/2b677022-3ca7-40d0-ba96-f88e6df9c517/46ec5320-e817-479c-a4c6-cd8e78c306de) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:01.845326 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] For port b037cf4d-0426-4c96-9e8b-fb99b6d7899f, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:01.860273 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] For port b037cf4d-0426-4c96-9e8b-fb99b6d7899f, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:01.944445 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d4b6f162-4113-4e62-8963-44d26991abbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:01.965419 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.011195 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.088287 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bc6797-5cab-414c-8a73-547cb98bb3c4 None None] Pushing event updated for resources: {'Port': ['ID=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:02.104291 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:02.105130 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:02.155993 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ef3d283d-240b-4f68-915c-45e8a5de4416 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:02.158253 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d4b6f162-4113-4e62-8963-44d26991abbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.161018 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.186917 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.236664 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d4b6f162-4113-4e62-8963-44d26991abbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.262693 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port ef3d283d-240b-4f68-915c-45e8a5de4416 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:02.263061 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.299106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:02.310812 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:02.318560 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:02.410408 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:02.413698 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d4b6f162-4113-4e62-8963-44d26991abbc admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=360d503e2877403f99dda6a4ee7a1b2d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7247381 Nov 11 14:25:02.417283 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60828) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:02.422517 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.437839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.445827 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4b6f162-4113-4e62-8963-44d26991abbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af8042c2-6e3a-472f-a1b7-68a1dffa711b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:02.473326 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38abe9a1-9cef-4dcd-bf19-6d1339566905 None None] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:02.516523 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port ef3d283d-240b-4f68-915c-45e8a5de4416, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ef3d283d-240b-4f68-915c-45e8a5de4416,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:02.620527 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f15f120-1c61-49f1-93b2-540751617971 req-f3a0a03c-eacc-475e-809d-3eb783095484 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:02.630173 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7037dbde-8f63-4883-a831-cf7b03460fa8 None None] Provisioning complete for port ef3d283d-240b-4f68-915c-45e8a5de4416 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:02.633089 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7037dbde-8f63-4883-a831-cf7b03460fa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.638520 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7f15f120-1c61-49f1-93b2-540751617971 req-f3a0a03c-eacc-475e-809d-3eb783095484 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.3513386 Nov 11 14:25:02.661850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.663253 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:02.679310 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Pushing event updated for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:02.762055 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:24:58Z', 'revision_number': 3, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:02.798942 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d53035b5-efb7-4df6-a7fe-bbee6e4ed12f None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:24:58Z', 'revision_number': 3, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:02.864676 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.923216 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.935951 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=ef3d283d-240b-4f68-915c-45e8a5de4416,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:02.950696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.963946 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:02.986046 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7f15f120-1c61-49f1-93b2-540751617971 req-16b627a0-0188-4d1c-b623-c20a52fa008e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3217599 Nov 11 14:25:03.113520 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:03.113520 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.209966 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.218843 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.218843 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/af8042c2-6e3a-472f-a1b7-68a1dffa711b HTTP/1.1" status: 204 len: 168 time: 0.7927055 Nov 11 14:25:03.232857 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d34647-29be-4fe4-9009-3d030683ce0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af8042c2-6e3a-472f-a1b7-68a1dffa711b,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:03.296520 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:25:03.356053 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-11c33561-f0da-4d7d-9bc2-5ff8c3926ab2 None None] Provisioning complete for port 46ec5320-e817-479c-a4c6-cd8e78c306de triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:03.356605 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-11c33561-f0da-4d7d-9bc2-5ff8c3926ab2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.395632 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.450947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-11c33561-f0da-4d7d-9bc2-5ff8c3926ab2 None None] Port 46ec5320-e817-479c-a4c6-cd8e78c306de cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:03.502737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:03.514037 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:03.526260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:03.527195 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:03.582090 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.629721 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.634178 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2cff3780-2d0d-4ffb-8062-a5d78cf172bd admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.2858222 Nov 11 14:25:03.634402 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60866) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:03.667096 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:03.692732 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Pushing event updated for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:03.699921 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:03.798006 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7ecd9636-0c18-462b-8702-95ec1016fe28 None None] Provisioning complete for port ef3d283d-240b-4f68-915c-45e8a5de4416 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:03.798365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7ecd9636-0c18-462b-8702-95ec1016fe28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.026393 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60880) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:04.064437 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:04.069023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:04.112679 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ef3d283d-240b-4f68-915c-45e8a5de4416 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:04.293505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:25:04.334393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port ef3d283d-240b-4f68-915c-45e8a5de4416 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:04.335240 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.453870 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-dcad02cb-34bf-46c0-a6b5-0da2380496e6 None None] Provisioning complete for port 46ec5320-e817-479c-a4c6-cd8e78c306de triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:04.453870 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-dcad02cb-34bf-46c0-a6b5-0da2380496e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.491528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092754ff-9e90-45fd-976a-545c2903756b req-90ee0d24-b17c-4c78-a1f5-be754afbefbc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:04.494435 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-092754ff-9e90-45fd-976a-545c2903756b req-90ee0d24-b17c-4c78-a1f5-be754afbefbc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.2331245 Nov 11 14:25:04.520735 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:01Z', 'revision_number': 3, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:04.572531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60896) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:04.576348 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:04.576745 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Updating router e1d54a86-4f94-4dff-9795-2ecd9436c55e port a2276ac6-774c-4412-884e-d46de32946e4 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:04.584738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b037cf4d-0426-4c96-9e8b-fb99b6d7899f up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:04.602812 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-dcad02cb-34bf-46c0-a6b5-0da2380496e6 None None] Port 46ec5320-e817-479c-a4c6-cd8e78c306de cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:04.618073 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84953cd3-3468-4f82-8621-dab3117f65e9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.635692 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee3d3d49-f6fe-449d-a4ce-7d098f8cf73f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.639954 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.785059 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b037cf4d-0426-4c96-9e8b-fb99b6d7899f triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:04.785059 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.824893 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-092754ff-9e90-45fd-976a-545c2903756b req-ea7e37fa-7789-4495-9223-efb10f8120f9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2626293 Nov 11 14:25:04.827743 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:04.838066 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-fe02de92-f86b-4be0-b7dd-0d29d5077644 admin admin] 10.222.0.10 "PUT /v2.0/routers/589db83d-340f-42a5-815b-afa42568542b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6052024 Nov 11 14:25:04.944635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.961655 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:04.997441 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port b037cf4d-0426-4c96-9e8b-fb99b6d7899f, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:05.186676 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.212232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Allocated IP 172.20.0.1 (c68a47ca-25f9-4130-912b-bec65a17b2f1/a758aa63-a5a7-49f1-8370-ad64ffdcb95b/249d24ce-1e75-4ac7-ae15-555417147593) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:05.238436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.279661 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:05.291210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee3d3d49-f6fe-449d-a4ce-7d098f8cf73f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.322870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84953cd3-3468-4f82-8621-dab3117f65e9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.331355 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c776ee-427d-4110-8f4f-e7a4893f9fda req-2ad847da-e692-4c88-ac8f-f80b5bf006bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:05.332993 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e9c776ee-427d-4110-8f4f-e7a4893f9fda req-2ad847da-e692-4c88-ac8f-f80b5bf006bf service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.3639290 Nov 11 14:25:05.364554 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:05.378242 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:05.380443 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:05.432820 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e9c776ee-427d-4110-8f4f-e7a4893f9fda req-96f774ec-0595-4814-b26f-12c18d0c04d8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896742 Nov 11 14:25:05.444865 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.490665 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.496555 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84953cd3-3468-4f82-8621-dab3117f65e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.502464 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee3d3d49-f6fe-449d-a4ce-7d098f8cf73f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.508449 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:05.541773 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Attempting to bind port a2276ac6-774c-4412-884e-d46de32946e4 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:05.542145 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Attempting to bind port a2276ac6-774c-4412-884e-d46de32946e4 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:05.542506 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Attempting to bind port a2276ac6-774c-4412-884e-d46de32946e4 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:05.549150 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.589225 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:05.589935 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:05.589935 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.590314 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:05.590785 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Bound port: a2276ac6-774c-4412-884e-d46de32946e4, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:05.591191 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.601490 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1249bb8d-09fc-41fe-9766-6219a5b6cad4 None None] Pushing event updated for resources: {'Port': ['ID=a2276ac6-774c-4412-884e-d46de32946e4,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:05.604190 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-84953cd3-3468-4f82-8621-dab3117f65e9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5376663dabe849fea2ffcb68355d7b18&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0245943 Nov 11 14:25:05.608748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84953cd3-3468-4f82-8621-dab3117f65e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45ddb91a-2ab6-419d-8bc5-7e14135e1f95,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:05.611004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60918) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:05.620814 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ee3d3d49-f6fe-449d-a4ce-7d098f8cf73f admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=2687929a8abc41a1bc8a072a4d584271&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5911446 Nov 11 14:25:05.626381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:05.627149 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60922) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:05.650511 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:05.689525 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:05.698181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] For port a2276ac6-774c-4412-884e-d46de32946e4, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:05.703853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] For port a2276ac6-774c-4412-884e-d46de32946e4, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=a2276ac6-774c-4412-884e-d46de32946e4,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:05.708316 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.717845 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Pushing event updated for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:05.793845 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3d3d49-f6fe-449d-a4ce-7d098f8cf73f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4023a84-f451-471e-920b-7ed88e118f37,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:05.822223 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.832006 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:03Z', 'revision_number': 2, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:05.865738 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.899255 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b037cf4d-0426-4c96-9e8b-fb99b6d7899f up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:05.909746 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.944018 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:05.945829 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Updating router 589db83d-340f-42a5-815b-afa42568542b port 46ec5320-e817-479c-a4c6-cd8e78c306de binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:05.977458 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:05.998560 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.010927 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:06.015458 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:06.022906 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1249bb8d-09fc-41fe-9766-6219a5b6cad4 None None] Pushing event updated for resources: {'Port': ['ID=a2276ac6-774c-4412-884e-d46de32946e4,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:06.077658 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.080865 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b037cf4d-0426-4c96-9e8b-fb99b6d7899f triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:06.081404 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.131659 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-65ab74d5-7686-470d-a0eb-1c6ec1556391 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.159257 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.162733 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.164108 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/45ddb91a-2ab6-419d-8bc5-7e14135e1f95 HTTP/1.1" status: 204 len: 168 time: 0.5518901 Nov 11 14:25:06.214528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb17de41-872d-49a6-a18c-09aa6e446b45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45ddb91a-2ab6-419d-8bc5-7e14135e1f95,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:06.224363 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f110b29d-2f56-4075-91d9-e863673ab948 req-01ffe96f-5ba5-4d21-becb-0b8c228e6f70 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:06.233621 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f110b29d-2f56-4075-91d9-e863673ab948 req-01ffe96f-5ba5-4d21-becb-0b8c228e6f70 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.2734714 Nov 11 14:25:06.282470 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60940) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:06.291244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1999188518-network', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:06.321515 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.339004 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:06.392146 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f110b29d-2f56-4075-91d9-e863673ab948 req-37f88fa4-01fc-4b5d-afbd-0b7eba3f7abb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181152 Nov 11 14:25:06.548175 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Made reservation on behalf of 6f2d2f2a685f4d959d50143a77608757 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:06.554480 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.556620 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-65b9b088-c359-48ee-95b4-94dc6839c7bf None None] Provisioning complete for port 249d24ce-1e75-4ac7-ae15-555417147593 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:06.557089 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-65b9b088-c359-48ee-95b4-94dc6839c7bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.560409 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.562525 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.566189 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.568518 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.572312 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/d4023a84-f451-471e-920b-7ed88e118f37 HTTP/1.1" status: 204 len: 168 time: 0.9417305 Nov 11 14:25:06.592871 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8abfaad6-a8b6-4ceb-8776-978ac476a03f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4023a84-f451-471e-920b-7ed88e118f37,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:06.621757 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.631271 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-65b9b088-c359-48ee-95b4-94dc6839c7bf None None] Port 249d24ce-1e75-4ac7-ae15-555417147593 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:06.679560 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.684938 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.730562 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.731590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.762725 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:01Z', 'revision_number': 3, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:06.764155 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.795057 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e27d08d0-72b5-4594-ba4b-fe20fddc3aef None None] Pushing event updated for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:06.850195 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b0c3913-e07c-4a5a-bbd7-8a71ba819b1c None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:01Z', 'revision_number': 3, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:06.873209 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Attempting to bind port 46ec5320-e817-479c-a4c6-cd8e78c306de on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:06.874247 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=044927f8-76c9-4cbd-885c-8f840e0a5ef5,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:06.878341 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Attempting to bind port 46ec5320-e817-479c-a4c6-cd8e78c306de by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:06.879015 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Attempting to bind port 46ec5320-e817-479c-a4c6-cd8e78c306de on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:06.886839 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:06.888001 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:06.888879 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.889746 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Bound using segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:06.890389 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Bound port: 46ec5320-e817-479c-a4c6-cd8e78c306de, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:06.891242 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.900092 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 315} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:25:06.942151 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:06.944636 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Added segment 580bddf4-f60f-47cb-bede-2acfa2f8a614 of type vlan for network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a Nov 11 14:25:07.002482 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.016407 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Pushing event updated for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:07.056772 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-3e34775b-4197-4fe2-9605-e79b633fb66e None None] Provisioning complete for port 46ec5320-e817-479c-a4c6-cd8e78c306de triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:07.057202 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3e34775b-4197-4fe2-9605-e79b633fb66e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.060636 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] For port 46ec5320-e817-479c-a4c6-cd8e78c306de, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:07.064419 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] For port 46ec5320-e817-479c-a4c6-cd8e78c306de, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=46ec5320-e817-479c-a4c6-cd8e78c306de,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:07.077197 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:07.079913 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:07.125544 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.132036 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.133215 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:07.152458 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.153213 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-3e34775b-4197-4fe2-9605-e79b633fb66e None None] Port 46ec5320-e817-479c-a4c6-cd8e78c306de cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:07.310616 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0267003 Nov 11 14:25:07.316405 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 60966) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:07.338919 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Request body: {'subnet': {'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1999188518-subnet', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:07.339020 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:07.339347 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:24:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:07.346337 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e002b9b-9e8c-4bc0-989e-f9c81406ae9b admin admin] Pushing event updated for resources: {'Network': ['ID=9dca3278-f4fb-4e25-85f0-9ca999fb7b9a,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:07.354352 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e27d08d0-72b5-4594-ba4b-fe20fddc3aef None None] Pushing event updated for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=4']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:07.388809 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:25:07.397185 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:25:07.561586 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Made reservation on behalf of 6f2d2f2a685f4d959d50143a77608757 for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:07.571992 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.604570 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:07.716943 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-8cd9ae30-32f5-4686-8ea2-5f5929a3d8b5 None None] Provisioning complete for port 249d24ce-1e75-4ac7-ae15-555417147593 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:07.717849 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8cd9ae30-32f5-4686-8ea2-5f5929a3d8b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.815224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 60982) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:07.822279 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-8cd9ae30-32f5-4686-8ea2-5f5929a3d8b5 None None] Port 249d24ce-1e75-4ac7-ae15-555417147593 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:07.848919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1554296c-3c53-40cc-8d39-ea87a0bdd892 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:07.880509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:07.892570 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2552f89e-4d11-49cc-b973-63633fe03a6b admin admin] 10.222.0.10 "PUT /v2.0/routers/e1d54a86-4f94-4dff-9795-2ecd9436c55e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2555280 Nov 11 14:25:07.922615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device a2276ac6-774c-4412-884e-d46de32946e4 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:08.005208 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008e0d31-d0f4-453e-8b93-0c93febead5a req-acacba23-c5bb-49d0-b6a8-4f18ee91c937 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:08.007081 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-008e0d31-d0f4-453e-8b93-0c93febead5a req-acacba23-c5bb-49d0-b6a8-4f18ee91c937 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.2136333 Nov 11 14:25:08.053109 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] Provisioning complete for port 46ec5320-e817-479c-a4c6-cd8e78c306de triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:08.055824 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.138264 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1554296c-3c53-40cc-8d39-ea87a0bdd892 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.199389 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1554296c-3c53-40cc-8d39-ea87a0bdd892 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.241401 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:07Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:08.251890 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-008e0d31-d0f4-453e-8b93-0c93febead5a req-14c2fe80-5430-4924-b6ed-fa9696e9ad12 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2353778 Nov 11 14:25:08.294476 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1554296c-3c53-40cc-8d39-ea87a0bdd892 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=a2b5a6f91a554386a8ac1515d0f4f753&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4781177 Nov 11 14:25:08.303620 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 32772) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:08.304582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.307250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1554296c-3c53-40cc-8d39-ea87a0bdd892 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26ba105f-5357-4e6f-a91c-24f7e4917cff,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:08.349748 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port a2276ac6-774c-4412-884e-d46de32946e4 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:08.354426 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.354978 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e870956-c4f2-4b8a-a066-9536a13dc1ab None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:07Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:08.410443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.416222 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.431523 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] For port 46ec5320-e817-479c-a4c6-cd8e78c306de, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=46ec5320-e817-479c-a4c6-cd8e78c306de,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:08.514455 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.541628 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.566934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Pushing event updated for resources: {'Subnet': ['ID=d25d7151-3252-4fbf-aa10-04f095fc4ab4,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:08.622137 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Checking segment: {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:08.622526 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Network hostable DHCP agents. Network: 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:25:08.640582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-654c7c22-4a54-4a1c-a981-eb19c31d7a87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.679121 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.715066 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b5aa39-2e4a-4a51-a299-5bf4ce2c320a None None] Pushing event updated for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:08.731924 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:25:08.742777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.745099 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.749816 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port a2276ac6-774c-4412-884e-d46de32946e4, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=a2276ac6-774c-4412-884e-d46de32946e4,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:08.752032 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/26ba105f-5357-4e6f-a91c-24f7e4917cff HTTP/1.1" status: 204 len: 168 time: 0.4413903 Nov 11 14:25:08.772098 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4385f98b-353e-43e1-90af-a0def3ad795e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26ba105f-5357-4e6f-a91c-24f7e4917cff,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:08.837834 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.845492 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:08.857030 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:08.857030 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:08.864444 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8ad1f54-4198-41ab-919f-b44a181ad3ce None None] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:08.975142 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-943751b4-8ed5-40dd-a167-0329f1a7f76e admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.6469898 Nov 11 14:25:08.977776 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 32800) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:08.982734 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:09.173498 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768babd9-ff56-40f1-ba85-8cfdae7146f0 req-29a12e58-fdb2-4dea-bfd9-e0b129d6f320 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:09.179911 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-768babd9-ff56-40f1-ba85-8cfdae7146f0 req-29a12e58-fdb2-4dea-bfd9-e0b129d6f320 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1700504 Nov 11 14:25:09.205976 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.208081 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.226382 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:25:09.227268 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.308927 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-768babd9-ff56-40f1-ba85-8cfdae7146f0 req-29ddb954-f59c-4790-9ed0-86766852ae1f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1222675 Nov 11 14:25:09.419102 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 32810) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:09.425488 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1872591768', 'description': 'tempest-description--1703622096'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:09.428398 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.477301 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Allocated IP 172.20.0.2 (9dca3278-f4fb-4e25-85f0-9ca999fb7b9a/d25d7151-3252-4fbf-aa10-04f095fc4ab4/9531bbc6-e573-4973-9711-7996f7ff3dda) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:09.479529 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=a2276ac6-774c-4412-884e-d46de32946e4,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:09.540442 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.684516 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.686110 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:09.715620 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:09.717251 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:09.734059 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.796242 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.806083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.876590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d4b747c-5f16-473b-94d6-7b2f069d85b1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:09.909397 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:09.911174 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-236146c9-8896-4daf-b4ea-1125474c72f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.4901197 Nov 11 14:25:09.916391 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 32828) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:09.927303 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group_rule': {'security_group_id': '5d4b747c-5f16-473b-94d6-7b2f069d85b1', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:10.080517 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 46ec5320-e817-479c-a4c6-cd8e78c306de up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:10.109268 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.277092 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.303278 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.312720 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.333175 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:10.353213 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.410557 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6e5d023-ee10-49d8-ab78-205ea0f6645f,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:10.428077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.498579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.499769 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4b48f725-d60e-41df-a212-2a372e756bc4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5841262 Nov 11 14:25:10.504079 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 32856) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:10.507454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 46ec5320-e817-479c-a4c6-cd8e78c306de triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:10.508012 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.512181 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group_rule': {'security_group_id': '5d4b747c-5f16-473b-94d6-7b2f069d85b1', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:10.549984 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.567678 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c05cab1-585a-4aa8-b75a-283e3437473c req-14e6ff66-b7ec-4418-b091-73ecaf70ef5b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:10.575811 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c05cab1-585a-4aa8-b75a-283e3437473c req-14e6ff66-b7ec-4418-b091-73ecaf70ef5b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1405318 Nov 11 14:25:10.604146 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Allocated IP 172.27.1.25 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/461ff056-a4bb-4f30-a34a-129bfb032513) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:10.628379 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:10.658214 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:10.697810 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.704428 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:10.712873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Pushing event updated for resources: {'Port': ['ID=9531bbc6-e573-4973-9711-7996f7ff3dda,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:10.753440 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c05cab1-585a-4aa8-b75a-283e3437473c req-5dc6c7a7-ae8d-4562-86ff-05cfd8caf35e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1761291 Nov 11 14:25:10.860529 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Attempting to bind port 9531bbc6-e573-4973-9711-7996f7ff3dda on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:10.860910 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Attempting to bind port 9531bbc6-e573-4973-9711-7996f7ff3dda by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:10.861275 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Attempting to bind port 9531bbc6-e573-4973-9711-7996f7ff3dda on network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:10.866670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.867430 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device a2276ac6-774c-4412-884e-d46de32946e4 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:10.881920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.892261 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 24, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:10.892622 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Checking segment: {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:10.893022 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.893401 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Bound using segment: {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:10.893868 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Bound port: 9531bbc6-e573-4973-9711-7996f7ff3dda, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:10.894383 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.912294 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.930200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:10.950128 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a15ee98-52ce-4129-9ba3-b6fb12a39867,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:10.962253 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 2, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:10.998017 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:10.998402 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Updating router e1d54a86-4f94-4dff-9795-2ecd9436c55e port 249d24ce-1e75-4ac7-ae15-555417147593 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:11.012520 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.046870 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.051285 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] For port 9531bbc6-e573-4973-9711-7996f7ff3dda, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:11.053885 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port a2276ac6-774c-4412-884e-d46de32946e4 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:11.054242 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.057331 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.058514 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-3337e5d1-72bc-4aca-9f53-39d046b714fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5514026 Nov 11 14:25:11.060531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:11.061688 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 32870) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:11.062659 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] For port 9531bbc6-e573-4973-9711-7996f7ff3dda, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=9531bbc6-e573-4973-9711-7996f7ff3dda,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:11.066106 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:11.068772 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:11.072951 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:11.111169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Pushing event updated for resources: {'Port': ['ID=461ff056-a4bb-4f30-a34a-129bfb032513,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:11.176083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.192742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.327509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.366223 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed610166-fb18-4422-8a45-1b6d6d08d8a0 None None] Pushing event updated for resources: {'Port': ['ID=9531bbc6-e573-4973-9711-7996f7ff3dda,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:11.456029 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Allocated IP 172.27.1.140 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/523729a1-3191-4d9c-85dd-7a9155ac641b) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:11.501634 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-4f641564-d56b-49d9-a5ca-e69df0183f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:11.503309 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-4f641564-d56b-49d9-a5ca-e69df0183f6c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.0941949 Nov 11 14:25:11.539465 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.586989 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.587743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.657450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.711600 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.744098 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.765577 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3f987a-18d9-4453-93bb-a39979f0ecf1 None None] Pushing event updated for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:11.861413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-ef8cdce1-9c48-4946-aab6-9270f2d32878 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:11.864645 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-ef8cdce1-9c48-4946-aab6-9270f2d32878 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.3524566 Nov 11 14:25:11.866445 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Attempting to bind port 249d24ce-1e75-4ac7-ae15-555417147593 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:11.867142 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:11.868925 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Attempting to bind port 249d24ce-1e75-4ac7-ae15-555417147593 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:11.869468 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Attempting to bind port 249d24ce-1e75-4ac7-ae15-555417147593 on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:11.876764 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:11.880040 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:11.885300 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:11.886074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Checking segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:11.886693 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.887271 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Bound using segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:11.887868 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Bound port: 249d24ce-1e75-4ac7-ae15-555417147593, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:11.888244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:11.916190 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=523729a1-3191-4d9c-85dd-7a9155ac641b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:11.988528 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-9181a9a1-0e65-4099-8aec-2d43dfecf9df service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.1153691 Nov 11 14:25:12.009241 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 9531bbc6-e573-4973-9711-7996f7ff3dda up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:12.099292 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] For port 249d24ce-1e75-4ac7-ae15-555417147593, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:12.103716 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.138536 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] For port 249d24ce-1e75-4ac7-ae15-555417147593, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=249d24ce-1e75-4ac7-ae15-555417147593,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:12.154437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 9531bbc6-e573-4973-9711-7996f7ff3dda triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:12.154809 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.182628 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.211391 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32524ce4-6427-49b7-a5da-817a0ccbb37a req-15a5698c-1da6-4bdc-a4c0-ff71447438e6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:12.222498 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-32524ce4-6427-49b7-a5da-817a0ccbb37a req-15a5698c-1da6-4bdc-a4c0-ff71447438e6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.3099682 Nov 11 14:25:12.253665 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.264964 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] Provisioning complete for port 249d24ce-1e75-4ac7-ae15-555417147593 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:12.265328 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.293054 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-32524ce4-6427-49b7-a5da-817a0ccbb37a req-bb34f561-285b-4dc6-8f99-d5813b1c47f9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693588 Nov 11 14:25:12.358542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.514846 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:12.514846 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:12.514846 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3f987a-18d9-4453-93bb-a39979f0ecf1 None None] Pushing event updated for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:12.676703 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-e26f35d6-c7b5-4753-868a-37d36fdee41d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:12.681102 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-e26f35d6-c7b5-4753-868a-37d36fdee41d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.2595351 Nov 11 14:25:12.766753 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-571d4c52-044e-46a7-aaae-2ac6416e55ba service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0739906 Nov 11 14:25:12.769930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.774735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.884912 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.941185 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.952959 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:12.961680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.025671 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bd690b2-eeab-4292-830e-b26e82e0d92a None None] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:13.027017 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=523729a1-3191-4d9c-85dd-7a9155ac641b,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:13.036878 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-e9200d12-29d7-4ee5-bd21-112f31fe9ae4 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2624090 Nov 11 14:25:13.058628 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.062391 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-55a243e7-86d8-41cf-b329-23a5d74cac03 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.9994073 Nov 11 14:25:13.170576 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9a583d72-fec0-4404-9837-a3477d1b2cfc req-805c10fc-8089-47d3-8024-c77a187a6965 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250212 Nov 11 14:25:13.248580 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:13.251240 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 9531bbc6-e573-4973-9711-7996f7ff3dda, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=9531bbc6-e573-4973-9711-7996f7ff3dda,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:13.253084 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] For port 249d24ce-1e75-4ac7-ae15-555417147593, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=249d24ce-1e75-4ac7-ae15-555417147593,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:13.257969 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Router 5083b643-9750-4836-bc71-1e5be9581dc8 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102267) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:25:13.376850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.378554 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.467642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:13.487953 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Sync routers for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:13.506716 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:13.508985 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:13.525501 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 32960) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:13.546240 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f7428f-c245-4e14-a89e-77dc9bc80a71 req-de18bdb5-61ba-4604-b427-30436b5f4a2b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:13.560798 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-29f7428f-c245-4e14-a89e-77dc9bc80a71 req-de18bdb5-61ba-4604-b427-30436b5f4a2b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1065273 Nov 11 14:25:13.582255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.585518 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-cf507a90-6603-4c15-bc0a-69ded4df6e0d admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.6058960 Nov 11 14:25:13.589752 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f45b3c90-e57c-4ccc-bcab-f1295a72cd45 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-securitygroup--1872591768&fields=id&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 267 time: 0.0909462 Nov 11 14:25:13.594994 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 32964) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:13.613998 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a03d2d2b-3d7d-4ead-aa21-2dcc10bbc1eb None None] Pushing event updated for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:13.672946 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-0075e1a4-3f0b-4d98-acc5-08dba279a4ec None None] Provisioning complete for port 249d24ce-1e75-4ac7-ae15-555417147593 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:13.673691 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0075e1a4-3f0b-4d98-acc5-08dba279a4ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.728873 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:13.762124 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-29f7428f-c245-4e14-a89e-77dc9bc80a71 req-d12128aa-b6af-4fa6-89b9-32302a056544 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1869097 Nov 11 14:25:13.839223 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f0775f4e-a778-4664-a6f4-3520dee9e56a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:13.876807 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-40c5e9b6-b486-4c18-85ec-a79cc173c642 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:13.882798 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-40c5e9b6-b486-4c18-85ec-a79cc173c642 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 817 time: 0.2796650 Nov 11 14:25:13.904459 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-eb029076-e083-49b5-9f76-8825724a231a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/quotas/b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 375 time: 0.0164900 Nov 11 14:25:13.987170 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-1c948643-0699-416d-8267-ea3e27917ff8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0749688 Nov 11 14:25:14.041506 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=9531bbc6-e573-4973-9711-7996f7ff3dda,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:14.082694 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:11Z', 'revision_number': 3, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:14.111488 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:12Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:14.133401 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f1e63fff-93af-4c68-bd27-e2cd3726a084 service neutron] 10.222.0.10 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244791 Nov 11 14:25:14.168000 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Checking router: 5083b643-9750-4836-bc71-1e5be9581dc8 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:14.168356 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Updating router 5083b643-9750-4836-bc71-1e5be9581dc8 port 461ff056-a4bb-4f30-a34a-129bfb032513 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:14.173655 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7166580-4616-4164-9087-2dbac8cfe205 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:12Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:14.215940 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-0075e1a4-3f0b-4d98-acc5-08dba279a4ec None None] Provisioning complete for port 9531bbc6-e573-4973-9711-7996f7ff3dda triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:14.216391 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0075e1a4-3f0b-4d98-acc5-08dba279a4ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.264481 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.338216 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-9d1940fc-76ee-46bf-a012-e7059bc9432c service neutron] 10.222.0.10 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1940084 Nov 11 14:25:14.489680 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f0775f4e-a778-4664-a6f4-3520dee9e56a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.605918 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f0775f4e-a778-4664-a6f4-3520dee9e56a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.667947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-020ecf8a-c6e1-4b11-9ff7-e0f758b3f3b7 None None] Provisioning complete for port 9531bbc6-e573-4973-9711-7996f7ff3dda triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:14.668510 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-020ecf8a-c6e1-4b11-9ff7-e0f758b3f3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.770884 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-98708c52-e692-440b-b9f1-4b08aa674435 req-802b9ebf-89f1-44d5-996b-cc7bdd400712 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.0611439 Nov 11 14:25:14.777677 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f0775f4e-a778-4664-a6f4-3520dee9e56a admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d19e8558a426405f8d10072c0421877c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2478216 Nov 11 14:25:14.781575 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 32998) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:14.781836 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0775f4e-a778-4664-a6f4-3520dee9e56a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b44d15d-5941-4f10-a7ae-0610e1ca2516,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:14.846369 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:14.920243 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.005303 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.045460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ec503b-ffc5-4e49-9bd0-1d27bb979eb5 req-257611d0-4ac4-4b5d-aa0b-952b3652bae8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:15.058794 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d9ec503b-ffc5-4e49-9bd0-1d27bb979eb5 req-257611d0-4ac4-4b5d-aa0b-952b3652bae8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1094518 Nov 11 14:25:15.108164 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33006) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:15.151427 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.207392 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Allocated IP 172.20.0.1 (9dca3278-f4fb-4e25-85f0-9ca999fb7b9a/d25d7151-3252-4fbf-aa10-04f095fc4ab4/f448fe0f-023b-4bb2-b7ae-59c891f93f81) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:15.216423 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d9ec503b-ffc5-4e49-9bd0-1d27bb979eb5 req-8b3fb6db-cf9f-4c87-85e3-63880ef77e00 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1562099 Nov 11 14:25:15.264434 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.319217 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.321923 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.323050 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/1b44d15d-5941-4f10-a7ae-0610e1ca2516 HTTP/1.1" status: 204 len: 168 time: 0.5404847 Nov 11 14:25:15.339483 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deedfcf4-d2b5-4bfb-a9b7-d2fc0664c240 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b44d15d-5941-4f10-a7ae-0610e1ca2516,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:15.352576 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-521aea3f-e586-4069-bf17-d5a207748a77 None None] Pushing event updated for resources: {'Port': ['ID=461ff056-a4bb-4f30-a34a-129bfb032513,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:15.357944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.411252 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Attempting to bind port 461ff056-a4bb-4f30-a34a-129bfb032513 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:15.411653 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Attempting to bind port 461ff056-a4bb-4f30-a34a-129bfb032513 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:15.412582 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Attempting to bind port 461ff056-a4bb-4f30-a34a-129bfb032513 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:15.418476 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:15.419181 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:15.419625 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.420021 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:15.420135 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-87727bcc-7934-4ad0-817d-0b8c53605f7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.420494 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Bound port: 461ff056-a4bb-4f30-a34a-129bfb032513, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:15.420887 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.549622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-87727bcc-7934-4ad0-817d-0b8c53605f7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.559571 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] For port 461ff056-a4bb-4f30-a34a-129bfb032513, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:15.565527 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.571096 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] For port 461ff056-a4bb-4f30-a34a-129bfb032513, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=461ff056-a4bb-4f30-a34a-129bfb032513,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:15.623766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:15.629659 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:15.633853 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:15.634325 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.640789 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Pushing event updated for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:15.816102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-87727bcc-7934-4ad0-817d-0b8c53605f7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.851578 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:15.893351 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-87727bcc-7934-4ad0-817d-0b8c53605f7a admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=df8b19ca3a75402f8afd94c9dcd90fb9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7673488 Nov 11 14:25:15.893589 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33044) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:15.902759 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87727bcc-7934-4ad0-817d-0b8c53605f7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bce68f6-6ac3-4ccc-8b4b-230621f848a0,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:15.956508 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-521aea3f-e586-4069-bf17-d5a207748a77 None None] Pushing event updated for resources: {'Port': ['ID=461ff056-a4bb-4f30-a34a-129bfb032513,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:15.979793 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:15.979793 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:16.058634 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 9531bbc6-e573-4973-9711-7996f7ff3dda up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:16.099759 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ff16841d-7dc8-498d-b43d-30cb16edb347 req-0b274c60-c392-4bda-9d53-ce97fe82bc78 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.1758499 Nov 11 14:25:16.100629 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.158888 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.192257 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-977cd7eb-9ed7-4792-9171-c96d619099d2 None None] Provisioning complete for port f448fe0f-023b-4bb2-b7ae-59c891f93f81 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:16.192627 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-977cd7eb-9ed7-4792-9171-c96d619099d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.198623 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.334040 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-977cd7eb-9ed7-4792-9171-c96d619099d2 None None] Port f448fe0f-023b-4bb2-b7ae-59c891f93f81 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:16.352116 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 9531bbc6-e573-4973-9711-7996f7ff3dda triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:16.353101 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.371042 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:25:16.375299 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:16.377761 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.387938 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.387938 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/0bce68f6-6ac3-4ccc-8b4b-230621f848a0 HTTP/1.1" status: 204 len: 168 time: 0.4880235 Nov 11 14:25:16.430927 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5dea570-b363-4bec-90f4-94092ee0a07f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bce68f6-6ac3-4ccc-8b4b-230621f848a0,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:16.460301 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51cf8de0-8395-4722-a966-92ad444d0e4d req-ff2cf3d0-455a-44ef-aad5-21e2528a2eed tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:16.471788 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-51cf8de0-8395-4722-a966-92ad444d0e4d req-ff2cf3d0-455a-44ef-aad5-21e2528a2eed tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1556346 Nov 11 14:25:16.567522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33062) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:16.578757 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 249d24ce-1e75-4ac7-ae15-555417147593 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:16.580981 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-51cf8de0-8395-4722-a966-92ad444d0e4d req-a6c863c1-413f-4bc2-9cd8-9629c2a770e9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1081038 Nov 11 14:25:16.636361 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.653156 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0c822b16-d247-4b1a-832f-d0325b000219 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.670115 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 249d24ce-1e75-4ac7-ae15-555417147593 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:16.670502 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.705442 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.705917 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.898761 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'f448fe0f-023b-4bb2-b7ae-59c891f93f81', 'name': '', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'mac_address': 'fa:16:3e:51:e4:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_interface', 'standard_attr_id': 325, 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:14Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 1, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'subnets': [{'id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:16.904056 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Pushing event updated for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:16.946212 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0c822b16-d247-4b1a-832f-d0325b000219 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:16.949701 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b63ff704-ab23-49eb-b9d5-6766357c15fd None None] The sync data for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi is: [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'f448fe0f-023b-4bb2-b7ae-59c891f93f81', 'name': '', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'mac_address': 'fa:16:3e:51:e4:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_interface', 'standard_attr_id': 325, 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:14Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 1, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'subnets': [{'id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:17.028372 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0c822b16-d247-4b1a-832f-d0325b000219 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.092126 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:17.094985 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33076) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:17.095835 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-0c822b16-d247-4b1a-832f-d0325b000219 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=fdfdf85246974fde91685e99f3126cc2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5237226 Nov 11 14:25:17.103595 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:17.138417 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c822b16-d247-4b1a-832f-d0325b000219 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fa87266-1339-4024-8523-cf4633fb0835,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:17.158496 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.205756 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.352553 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a6e0eef4-045c-4d7e-b92f-f147d280e91e req-ea0dc5f3-0f19-42fb-b0b0-a53a040af9fa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.0425775 Nov 11 14:25:17.376687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Router 5083b643-9750-4836-bc71-1e5be9581dc8 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:25:17.389879 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.396849 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.398193 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/3fa87266-1339-4024-8523-cf4633fb0835 HTTP/1.1" status: 204 len: 168 time: 0.3021371 Nov 11 14:25:17.415964 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a273774-058f-4d4f-9a6c-7fcd50073a91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fa87266-1339-4024-8523-cf4633fb0835,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:17.427646 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33092) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:17.460219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-98773f94-de0d-41a1-96a0-5548c517f0cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.574615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-2f74a33d-d55b-44ed-999f-c7b3fd27014a None None] Provisioning complete for port f448fe0f-023b-4bb2-b7ae-59c891f93f81 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:17.575740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2f74a33d-d55b-44ed-999f-c7b3fd27014a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.678718 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-98773f94-de0d-41a1-96a0-5548c517f0cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.725581 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:17.730905 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-2f74a33d-d55b-44ed-999f-c7b3fd27014a None None] Port f448fe0f-023b-4bb2-b7ae-59c891f93f81 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:17.741206 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-98773f94-de0d-41a1-96a0-5548c517f0cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.749948 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-3b334c40-6a48-4802-96cc-a06b2040a9aa admin admin] 10.222.0.10 "PUT /v2.0/routers/5083b643-9750-4836-bc71-1e5be9581dc8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1480544 Nov 11 14:25:17.798380 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-98773f94-de0d-41a1-96a0-5548c517f0cf admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=cc735a15073741fab32751f4a70fa411&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3691902 Nov 11 14:25:17.799787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98773f94-de0d-41a1-96a0-5548c517f0cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dea0a9b1-4d6e-4e3f-81bf-ab55b040a2a5,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:17.800895 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33108) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:17.899403 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:17.949938 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.073674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-790e0d04-c40c-4a9e-a616-d7c9e5e375ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:18.075326 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-790e0d04-c40c-4a9e-a616-d7c9e5e375ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 817 time: 0.1779876 Nov 11 14:25:18.153925 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.163117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.163117 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/dea0a9b1-4d6e-4e3f-81bf-ab55b040a2a5 HTTP/1.1" status: 204 len: 168 time: 0.3585911 Nov 11 14:25:18.163117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33122) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:18.180415 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9975cf70-ad8b-4c7e-b9bc-91a3799acd97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dea0a9b1-4d6e-4e3f-81bf-ab55b040a2a5,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:18.185076 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-335459dd-1269-4615-bd54-9cdf4c7ae357 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 380 time: 0.0960257 Nov 11 14:25:18.196203 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'port': {'device_id': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'admin_state_up': True, 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'security_groups': ['5d4b747c-5f16-473b-94d6-7b2f069d85b1']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:18.410682 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Made reservation on behalf of b69e80bc4d824db9a0104c514f7dc8fa for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:18.414919 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.511924 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-006486c2-1ff0-470d-aa74-3113a1d9d1d6 req-33b0b752-80cb-4b60-ac04-e446193dfd1c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.0344269 Nov 11 14:25:18.552253 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Allocated IP 172.20.0.9 (c68a47ca-25f9-4130-912b-bec65a17b2f1/a758aa63-a5a7-49f1-8370-ad64ffdcb95b/4c18064d-696c-4c89-af13-19525b371b78) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:18.567524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33138) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:18.591104 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-413fcb74-23e4-41f8-9783-282dec665f5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.615529 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33140) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:18.627517 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1062906159', 'description': 'tempest-secgroup-smoke-1062906159 description', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:18.758815 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-413fcb74-23e4-41f8-9783-282dec665f5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.779998 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.800954 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.838053 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-413fcb74-23e4-41f8-9783-282dec665f5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.961881 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.969298 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-413fcb74-23e4-41f8-9783-282dec665f5b admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=ff206001e2234e9fb130eb6a5e03425b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4001157 Nov 11 14:25:18.970408 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33158) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:18.975098 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7fb10ddb-60bc-43f1-b344-0eb4c2186546 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:18.976639 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413fcb74-23e4-41f8-9783-282dec665f5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=936c7d84-ba1a-4429-801d-6f3aa21b0be4,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:18.986200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.029110 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:19.032944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:19.037524 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:19.078318 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe59d85-d038-48ad-9535-bf7b2d6feb15 req-629035f2-edc6-4bca-b9a3-b9b80d408a19 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:19.080717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:19.091861 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fe59d85-d038-48ad-9535-bf7b2d6feb15 req-629035f2-edc6-4bca-b9a3-b9b80d408a19 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1533308 Nov 11 14:25:19.096532 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.144456 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:19.145554 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.157698 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.214764 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.216344 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5996230 Nov 11 14:25:19.219393 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33162) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:19.226520 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:19.242200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc271735-6354-4566-9298-86fbf69bce71 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2cfa354d-b685-49ff-add6-9fea82052f27,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:19.273603 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.298391 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fe59d85-d038-48ad-9535-bf7b2d6feb15 req-62ff62f7-433b-4205-9585-ecc28605169a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2083535 Nov 11 14:25:19.318689 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7fb10ddb-60bc-43f1-b344-0eb4c2186546 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.318887 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4b937b67-6713-4d01-957f-0ea0b9bb61c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1246324 Nov 11 14:25:19.337885 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Request body: {'port': {'device_id': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:19.403789 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c933d14c-8d72-400e-b4bf-165dff5f2caf None None] Provisioning complete for port 4c18064d-696c-4c89-af13-19525b371b78 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:19.405216 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c933d14c-8d72-400e-b4bf-165dff5f2caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.448691 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7fb10ddb-60bc-43f1-b344-0eb4c2186546 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.484644 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.502697 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.505392 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.508285 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/936c7d84-ba1a-4429-801d-6f3aa21b0be4 HTTP/1.1" status: 204 len: 168 time: 0.5326021 Nov 11 14:25:19.509192 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c933d14c-8d72-400e-b4bf-165dff5f2caf None None] Port 4c18064d-696c-4c89-af13-19525b371b78 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:25:19.517323 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33178) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:19.522579 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.542275 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7fb10ddb-60bc-43f1-b344-0eb4c2186546 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=aaabf3adb20b425788382f69eaeaa19b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3701563 Nov 11 14:25:19.542275 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb10ddb-60bc-43f1-b344-0eb4c2186546 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85b0f733-2fe2-47a0-8294-7bfcdcb94a06,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:19.542275 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33186) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:19.581639 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2cfd79-ccdc-4731-b3f1-5e447f6522be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=936c7d84-ba1a-4429-801d-6f3aa21b0be4,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:19.645883 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.651404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.699969 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.734894 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40c4680-6892-4c27-8688-1ccdbe51985f req-06e83583-bcdd-4a87-bf95-d4b3a48008bf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:19.750099 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d40c4680-6892-4c27-8688-1ccdbe51985f req-06e83583-bcdd-4a87-bf95-d4b3a48008bf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 931 time: 0.1057997 Nov 11 14:25:19.797376 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1311d155-04ea-4e07-9a7e-9185c9363060 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.842835 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:19.929363 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d40c4680-6892-4c27-8688-1ccdbe51985f req-4b233f80-b51c-4592-aa5d-28ac513685ca tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1862783 Nov 11 14:25:19.931752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 461ff056-a4bb-4f30-a34a-129bfb032513 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:20.023086 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 461ff056-a4bb-4f30-a34a-129bfb032513 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:20.023704 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.051493 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.056240 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.060583 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/85b0f733-2fe2-47a0-8294-7bfcdcb94a06 HTTP/1.1" status: 204 len: 168 time: 0.5174551 Nov 11 14:25:20.075477 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5355cb-1d6f-4dcd-b759-b21bf7a3c5a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85b0f733-2fe2-47a0-8294-7bfcdcb94a06,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.085275 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.087153 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8666291 Nov 11 14:25:20.093737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33206) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:20.098663 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:20.109890 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eff84ce-511b-4f32-a231-8d23b7a81bed tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4315fefd-2f63-4d63-99ec-cb4fcca81960,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.146308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1311d155-04ea-4e07-9a7e-9185c9363060 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.159643 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.194475 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 461ff056-a4bb-4f30-a34a-129bfb032513, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=461ff056-a4bb-4f30-a34a-129bfb032513,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:20.226155 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:25:20.230291 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.248715 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1311d155-04ea-4e07-9a7e-9185c9363060 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.254178 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Transition to ACTIVE for port object 4c18064d-696c-4c89-af13-19525b371b78 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:25:20.271863 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.307141 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.315581 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1311d155-04ea-4e07-9a7e-9185c9363060 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8aa59679-5c21-42d4-8869-3517f043043b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.322369 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1311d155-04ea-4e07-9a7e-9185c9363060 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=52d94f1dff064e2f80a40add4aa88519&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8040504 Nov 11 14:25:20.325639 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33214) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:20.346839 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.387798 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.405514 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=461ff056-a4bb-4f30-a34a-129bfb032513,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.461435 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.475337 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.507587 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.540276 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=303471c0-d16a-444d-b028-9af7817058c4,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.550165 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.603111 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Attempting to bind port 4c18064d-696c-4c89-af13-19525b371b78 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:20.603432 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Attempting to bind port 4c18064d-696c-4c89-af13-19525b371b78 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:20.603767 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Attempting to bind port 4c18064d-696c-4c89-af13-19525b371b78 on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:20.610859 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Port 4c18064d-696c-4c89-af13-19525b371b78 on network c68a47ca-25f9-4130-912b-bec65a17b2f1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:25:20.610859 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Attempting to bind port 4c18064d-696c-4c89-af13-19525b371b78 on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:20.616981 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:20.617357 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Checking segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:20.617739 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Bound using segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:20.618184 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Bound port: 4c18064d-696c-4c89-af13-19525b371b78, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:20.618600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.638281 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.641352 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-6f5c88c7-91df-4b7c-802a-aa8e9902fedb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5437934 Nov 11 14:25:20.641636 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33226) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:20.646626 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:20.692775 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:20.696109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:20.747474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.750045 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.751663 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/8aa59679-5c21-42d4-8869-3517f043043b HTTP/1.1" status: 204 len: 168 time: 0.4245284 Nov 11 14:25:20.754492 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.759385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b377ae6-82aa-4d6c-a7cf-86b17f5569ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8aa59679-5c21-42d4-8869-3517f043043b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.805053 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.839131 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.851930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:20.852586 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.857159 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] 10.222.0.11 "PUT /v2.0/ports/4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 1093 time: 1.5268147 Nov 11 14:25:20.857782 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:25:20.860267 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b9395a0-3691-495e-8fea-9c9be0c96b3f" -d '{"events": [{"name": "network-changed", "server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:25:20.908568 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12bb516-dd53-4510-861f-f6e6c483ea8f service neutron] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:20.924748 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:20.939468 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:25:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d968540e-5174-46e7-8e55-cd649a421fbe x-openstack-request-id: req-d968540e-5174-46e7-8e55-cd649a421fbe {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:25:20.939997 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:25:20.940169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-d968540e-5174-46e7-8e55-cd649a421fbe {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:25:20.940990 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'status': 'completed', 'code': 200} Nov 11 14:25:20.945169 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98f795e0-6dcb-4533-a8f1-a6c0086a6cac,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:21.002590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33240) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:21.038616 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-09858eb6-098e-48ae-8520-e05ff1338742 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.042150 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-f28aee7f-4caf-4b7a-84f4-050e124bb150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:21.044079 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-f28aee7f-4caf-4b7a-84f4-050e124bb150 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1096 time: 0.0763795 Nov 11 14:25:21.059404 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.059832 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9f1723e7-9260-4813-a6e4-0345030571d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4170337 Nov 11 14:25:21.062534 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33242) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:21.106912 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:21.234071 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-09858eb6-098e-48ae-8520-e05ff1338742 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.315696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82713ab-d808-4748-9c40-42eb4a0e7c89 req-dfe3a8a8-00a3-4457-8739-b2b7390315e6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:21.317194 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c82713ab-d808-4748-9c40-42eb4a0e7c89 req-dfe3a8a8-00a3-4457-8739-b2b7390315e6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.2799151 Nov 11 14:25:21.347685 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-09858eb6-098e-48ae-8520-e05ff1338742 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.375786 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.399044 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-2756cb72-644a-4044-ba95-5faaebd5365c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:21.400756 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-2756cb72-644a-4044-ba95-5faaebd5365c service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&shared=False HTTP/1.1" status: 200 len: 918 time: 0.3424189 Nov 11 14:25:21.403805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Sync routers for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:21.419244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:21.420438 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-09858eb6-098e-48ae-8520-e05ff1338742 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=70cb00811b464f69b48bcd7f0fb6be57&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4164290 Nov 11 14:25:21.425052 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:21.426045 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33248) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:21.432959 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09858eb6-098e-48ae-8520-e05ff1338742 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=814e7d9f-9686-4138-ab34-baae0c893fc5,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:21.477268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c82713ab-d808-4748-9c40-42eb4a0e7c89 req-1bf04cef-6c8e-44a5-9138-7aa595fb0733 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1534781 Nov 11 14:25:21.517453 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.576378 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.603155 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.644263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-00fe46f4-55c1-49a1-873f-85d358f1a22d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:21.645967 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5b9395a0-3691-495e-8fea-9c9be0c96b3f req-00fe46f4-55c1-49a1-873f-85d358f1a22d service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2371213 Nov 11 14:25:21.701455 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:21.710185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33256) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:21.719936 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.724758 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.735240 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/814e7d9f-9686-4138-ab34-baae0c893fc5 HTTP/1.1" status: 204 len: 168 time: 0.3057928 Nov 11 14:25:21.759440 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.765287 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663fc054-4987-4e66-8705-0d1fab6e8df7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=814e7d9f-9686-4138-ab34-baae0c893fc5,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:21.852608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6b4c6446-5114-4a43-9827-97129be85adf,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:21.885473 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 461ff056-a4bb-4f30-a34a-129bfb032513 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:21.886153 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a70397db-0d09-4cc0-9063-bc2adf20d2a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.894055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-fcce25f7-22bd-4b2a-b289-250f44ecf067 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:21.894055 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-fcce25f7-22bd-4b2a-b289-250f44ecf067 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1096 time: 0.1749916 Nov 11 14:25:21.948606 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:21.952305 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-faedce47-e6de-4004-9b51-126544fef676 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.8530908 Nov 11 14:25:21.952654 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33270) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:21.962027 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:21.967752 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-178cd5f3-7b72-44bb-b8ae-b3117071c305 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 217 time: 0.0634561 Nov 11 14:25:22.008569 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 461ff056-a4bb-4f30-a34a-129bfb032513 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:22.008931 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.054296 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'f448fe0f-023b-4bb2-b7ae-59c891f93f81', 'name': '', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'mac_address': 'fa:16:3e:51:e4:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_interface', 'standard_attr_id': 325, 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:14Z', 'updated_at': '2021-11-11T14:25:16Z', 'revision_number': 2, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'subnets': [{'id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:22.054554 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-bf4c4275-ce91-403f-85ad-12c06e3490e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:22.055882 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-bf4c4275-ce91-403f-85ad-12c06e3490e3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0674605 Nov 11 14:25:22.077961 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a70397db-0d09-4cc0-9063-bc2adf20d2a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.087971 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Checking router: 5083b643-9750-4836-bc71-1e5be9581dc8 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:22.089315 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Updating router 5083b643-9750-4836-bc71-1e5be9581dc8 port f448fe0f-023b-4bb2-b7ae-59c891f93f81 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:25:22.108910 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.securitygroups_db [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Project 2d09ad6536ff49c4b4e43c8239742bc5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:25:22.116301 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4d7be19f-6fb0-49d5-9108-c694cdd6964a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:22.119134 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.123718 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-4d7be19f-6fb0-49d5-9108-c694cdd6964a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0584939 Nov 11 14:25:22.136260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.202068 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a70397db-0d09-4cc0-9063-bc2adf20d2a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.217731 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.262355 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a70397db-0d09-4cc0-9063-bc2adf20d2a0 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=720e208e0e5c470580b246a1ffe87f8c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5471973 Nov 11 14:25:22.262355 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70397db-0d09-4cc0-9063-bc2adf20d2a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0abf57d-66ae-49c0-ad24-9fed0f5e0350,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:22.262661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33276) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:22.295613 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-8c5b434f-ccc4-4ed2-bfa8-5669e799cc89 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1603205 Nov 11 14:25:22.302700 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.327982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5307e96f-c803-42e5-9dfe-a345a7625e4f,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:22.344368 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.376373 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.425571 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.429277 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-92f00b4b-8731-4139-af7a-d045540d729e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4731359 Nov 11 14:25:22.430626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33286) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:22.437613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'security_group_rule': {'security_group_id': '2cfa354d-b685-49ff-add6-9fea82052f27', 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:22.471720 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6bacb8f6-91dd-41f4-a615-4857dbaca8b1 req-c20af71e-d64f-4bb1-8298-a00d98164870 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1680095 Nov 11 14:25:22.501449 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.541550 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.544266 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.545395 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/c0abf57d-66ae-49c0-ad24-9fed0f5e0350 HTTP/1.1" status: 204 len: 168 time: 0.2826524 Nov 11 14:25:22.555975 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e371886c-b0ea-4ce2-8aaf-84d6e42c58a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0abf57d-66ae-49c0-ad24-9fed0f5e0350,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:22.599083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.599376 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.securitygroups_db [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Project 2d09ad6536ff49c4b4e43c8239742bc5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:25:22.604712 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.622077 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ccbaa8e-0b9f-4e2a-88d8-c8f9d0dbd469 req-e4f385fa-0984-46a0-969d-d17809e41ca9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:22.623680 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0ccbaa8e-0b9f-4e2a-88d8-c8f9d0dbd469 req-e4f385fa-0984-46a0-969d-d17809e41ca9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0567827 Nov 11 14:25:22.675329 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4d89e3-2115-4e33-a461-440b5443df99 None None] Pushing event updated for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:22.687467 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.710177 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0ccbaa8e-0b9f-4e2a-88d8-c8f9d0dbd469 req-2effd503-859d-4e17-b03c-4d0b9b30780b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643551 Nov 11 14:25:22.741775 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Attempting to bind port f448fe0f-023b-4bb2-b7ae-59c891f93f81 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:22.742530 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Attempting to bind port f448fe0f-023b-4bb2-b7ae-59c891f93f81 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:22.743032 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Attempting to bind port f448fe0f-023b-4bb2-b7ae-59c891f93f81 on network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:22.751990 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:22.762524 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Checking segment: {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:22.762658 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.762755 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.762755 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Bound using segment: {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:22.762755 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Bound port: f448fe0f-023b-4bb2-b7ae-59c891f93f81, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '580bddf4-f60f-47cb-bede-2acfa2f8a614', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 315, 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:22.762755 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.781365 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d304934-1c93-43d5-861f-e0feec375931,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:22.831059 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] For port f448fe0f-023b-4bb2-b7ae-59c891f93f81, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:22.835156 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] For port f448fe0f-023b-4bb2-b7ae-59c891f93f81, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=f448fe0f-023b-4bb2-b7ae-59c891f93f81,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:22.865494 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:22.866759 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-f123e703-7324-4c2b-bf95-3b05cd960113 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4346671 Nov 11 14:25:22.918567 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.002536 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] Provisioning complete for port f448fe0f-023b-4bb2-b7ae-59c891f93f81 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:23.002908 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.036111 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4d89e3-2115-4e33-a461-440b5443df99 None None] Pushing event updated for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:23.044946 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:23.045595 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:23.214984 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.227392 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:23.327634 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] For port f448fe0f-023b-4bb2-b7ae-59c891f93f81, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=f448fe0f-023b-4bb2-b7ae-59c891f93f81,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:23.348186 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33386) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:23.421662 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.493759 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-21e8e114-068b-48c5-b5f5-9d7433ce11de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.511139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475c89dc-6831-4188-b61f-77eca68262a5 None None] Pushing event updated for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:23.583147 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-21e8e114-068b-48c5-b5f5-9d7433ce11de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.592952 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-11d6f945-44fa-4689-9199-060d7532fbb2 None None] Provisioning complete for port f448fe0f-023b-4bb2-b7ae-59c891f93f81 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:23.596766 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-11d6f945-44fa-4689-9199-060d7532fbb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.637220 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'f448fe0f-023b-4bb2-b7ae-59c891f93f81', 'name': '', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'mac_address': 'fa:16:3e:51:e4:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_interface', 'standard_attr_id': 325, 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:14Z', 'updated_at': '2021-11-11T14:25:22Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'subnets': [{'id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:23.650278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-21e8e114-068b-48c5-b5f5-9d7433ce11de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.695402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e8e114-068b-48c5-b5f5-9d7433ce11de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc4fb7a6-5382-480c-ab9b-6b1bbf527799,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:23.697720 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d8193e0-3131-47c4-bb01-fadde5757908 None None] The sync data for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi is: [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:25:15Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'f448fe0f-023b-4bb2-b7ae-59c891f93f81', 'name': '', 'network_id': '9dca3278-f4fb-4e25-85f0-9ca999fb7b9a', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'mac_address': 'fa:16:3e:51:e4:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_interface', 'standard_attr_id': 325, 'fixed_ips': [{'subnet_id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:14Z', 'updated_at': '2021-11-11T14:25:22Z', 'revision_number': 4, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'subnets': [{'id': 'd25d7151-3252-4fbf-aa10-04f095fc4ab4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:23.712762 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-21e8e114-068b-48c5-b5f5-9d7433ce11de admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=a3a965d14bba4a0680e6d865ee1b6c8b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3666079 Nov 11 14:25:23.713148 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33406) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:23.796795 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.827129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:23.908539 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device f448fe0f-023b-4bb2-b7ae-59c891f93f81 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:23.921493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d39cc83-7b88-4533-a308-64292b494c7e req-936e0a51-890f-4e72-93ee-92d4847b6048 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:23.925225 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d39cc83-7b88-4533-a308-64292b494c7e req-936e0a51-890f-4e72-93ee-92d4847b6048 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0951250 Nov 11 14:25:24.015173 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:24.018501 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:24.022275 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/dc4fb7a6-5382-480c-ab9b-6b1bbf527799 HTTP/1.1" status: 204 len: 168 time: 0.3052835 Nov 11 14:25:24.025588 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d39cc83-7b88-4533-a308-64292b494c7e req-80655103-db7d-43a2-ba21-8b06d24b5967 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0994165 Nov 11 14:25:24.027711 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port f448fe0f-023b-4bb2-b7ae-59c891f93f81 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:24.028128 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:24.048069 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee24c787-55a3-4771-a525-faf43e0df53c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc4fb7a6-5382-480c-ab9b-6b1bbf527799,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:25.183259 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbc32c7-2694-444b-a9d7-85d31a693cfe req-01718604-b720-4140-ac54-5ce5cacc5a17 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:25.184757 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9cbc32c7-2694-444b-a9d7-85d31a693cfe req-01718604-b720-4140-ac54-5ce5cacc5a17 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0770037 Nov 11 14:25:25.241894 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9cbc32c7-2694-444b-a9d7-85d31a693cfe req-0213ebe3-d54f-4c5e-a567-ee6f17d567f7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506783 Nov 11 14:25:25.727762 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:25:25.829016 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33526) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:25.950633 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:25.965515 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4c18064d-696c-4c89-af13-19525b371b78', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:25:26.004420 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.019684 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:25:26.043129 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:26.055969 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf39f2b1-6dd7-48cf-8e1b-17fc45a59d77 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.159134 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.168667 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf39f2b1-6dd7-48cf-8e1b-17fc45a59d77 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.234008 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:26.238154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf39f2b1-6dd7-48cf-8e1b-17fc45a59d77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.283978 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bf39f2b1-6dd7-48cf-8e1b-17fc45a59d77 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=679f286a0f3446e985af20748858b6e5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4535706 Nov 11 14:25:26.284838 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf39f2b1-6dd7-48cf-8e1b-17fc45a59d77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86f81365-16fc-4594-83cd-3b323e3de3e1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:26.289816 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33550) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:26.390460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.422711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.441078 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4c18064d-696c-4c89-af13-19525b371b78'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:25:26.447595 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ce2431-f922-4d38-afcd-b2711efa0e3f req-e41a74ff-00a1-4278-aca6-00ba1c3fcf91 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:26.449634 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-80ce2431-f922-4d38-afcd-b2711efa0e3f req-e41a74ff-00a1-4278-aca6-00ba1c3fcf91 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.1125057 Nov 11 14:25:26.529059 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-80ce2431-f922-4d38-afcd-b2711efa0e3f req-ee2b73dd-69fa-4566-8b86-15c592429129 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0676680 Nov 11 14:25:26.661931 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.665991 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:26.669157 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/86f81365-16fc-4594-83cd-3b323e3de3e1 HTTP/1.1" status: 204 len: 168 time: 0.3715918 Nov 11 14:25:26.676246 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223bf936-d7e1-4390-b6a3-7dc34ea4ba0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86f81365-16fc-4594-83cd-3b323e3de3e1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:27.699724 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-084a5ddc-55e8-42cd-a57e-2375bc02c7df req-5a5a0fe6-56bb-4772-9b41-be1a3d611042 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:27.701213 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-084a5ddc-55e8-42cd-a57e-2375bc02c7df req-5a5a0fe6-56bb-4772-9b41-be1a3d611042 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.0612171 Nov 11 14:25:27.763950 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-084a5ddc-55e8-42cd-a57e-2375bc02c7df req-f637cc29-a98a-4f95-b505-5767851b98f9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562303 Nov 11 14:25:28.397460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33620) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:28.415045 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:28.507424 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-63065052-c801-4763-8628-45e2bd5e7a8d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.547842 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 4c18064d-696c-4c89-af13-19525b371b78 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:25:28.553915 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4c18064d-696c-4c89-af13-19525b371b78 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:28.554473 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.601338 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-63065052-c801-4763-8628-45e2bd5e7a8d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.656016 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-63065052-c801-4763-8628-45e2bd5e7a8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.664542 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.729156 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63065052-c801-4763-8628-45e2bd5e7a8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4317f437-ada6-4a5f-9af0-b5d6e7b6efaa,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:28.736600 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-63065052-c801-4763-8628-45e2bd5e7a8d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d045130bf4474d2293f65391acef079f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3374267 Nov 11 14:25:28.746788 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33640) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:28.762503 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:28.763588 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:25:28.769616 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e534077f-262c-4c25-816e-7bdf1025f0c0" -d '{"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:25:28.819109 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.834917 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:25:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebd3eb7c-fb78-4891-8d32-2f10fd8713b8 x-openstack-request-id: req-ebd3eb7c-fb78-4891-8d32-2f10fd8713b8 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:25:28.835235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:25:28.835521 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-ebd3eb7c-fb78-4891-8d32-2f10fd8713b8 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:25:28.835915 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'code': 200} Nov 11 14:25:28.845597 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.856287 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:28.909706 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:28.961501 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476da4f6-b5dc-4b9f-8afd-b6247be01c7b req-e0caea3a-e596-4fe2-acea-d58934c61ede tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:28.964039 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-476da4f6-b5dc-4b9f-8afd-b6247be01c7b req-e0caea3a-e596-4fe2-acea-d58934c61ede tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0794234 Nov 11 14:25:29.017727 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-476da4f6-b5dc-4b9f-8afd-b6247be01c7b req-2d5fa5e5-705f-4e65-9828-509699b74e25 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472722 Nov 11 14:25:29.024132 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:29.027084 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:29.028108 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4317f437-ada6-4a5f-9af0-b5d6e7b6efaa HTTP/1.1" status: 204 len: 168 time: 0.2801194 Nov 11 14:25:29.036048 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f068cad5-64da-4a9c-a761-050b5f66df2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4317f437-ada6-4a5f-9af0-b5d6e7b6efaa,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:29.253752 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4475bd-0b92-474a-98c6-3dd3bb2f0537 req-565f55f6-f5e5-4f38-af6a-ec7b1e22d6ff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:29.255234 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba4475bd-0b92-474a-98c6-3dd3bb2f0537 req-565f55f6-f5e5-4f38-af6a-ec7b1e22d6ff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0494270 Nov 11 14:25:29.304559 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba4475bd-0b92-474a-98c6-3dd3bb2f0537 req-1f0ae48b-09cc-40be-a326-d7559ef10ab6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429893 Nov 11 14:25:30.002617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33680) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:30.094785 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1413078939-network', 'tenant_id': '67dc223b706f43978cc8671a6462f9d5'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:30.144252 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87308ccb-454f-4c4f-aed6-e08e54cd420c req-07dab9d7-7acf-467d-b5fc-f747923e8f76 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.145809 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-87308ccb-454f-4c4f-aed6-e08e54cd420c req-07dab9d7-7acf-467d-b5fc-f747923e8f76 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0524054 Nov 11 14:25:30.187326 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Made reservation on behalf of 67dc223b706f43978cc8671a6462f9d5 for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:30.189658 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.192228 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-87308ccb-454f-4c4f-aed6-e08e54cd420c req-395d7058-1cee-4706-8287-b8ae8e656402 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405831 Nov 11 14:25:30.198239 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.274822 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.324660 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.360725 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 305} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:25:30.367847 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14ff9c30-b4b4-488a-99fe-4ff6878884d9,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:30.379030 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.379389 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Added segment ddeb9def-079c-4756-a438-c91278e6acb9 of type vlan for network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 Nov 11 14:25:30.402229 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-3b2ac9a3-b49e-4bb8-9e81-d0a954dddc99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.403823 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-3b2ac9a3-b49e-4bb8-9e81-d0a954dddc99 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.0747592 Nov 11 14:25:30.461214 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.489533 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa692ab-5c53-442f-af64-36248ab12f35 req-7201577d-6d42-49ed-a74e-5343aaaf9e9c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.491041 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fa692ab-5c53-442f-af64-36248ab12f35 req-7201577d-6d42-49ed-a74e-5343aaaf9e9c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0958149 Nov 11 14:25:30.507174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-806a9d40-de40-40c8-afc4-ee3034078a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.508938 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-806a9d40-de40-40c8-afc4-ee3034078a6c service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.0956867 Nov 11 14:25:30.541941 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fa692ab-5c53-442f-af64-36248ab12f35 req-25190816-40d0-4f88-ab11-4a6d73bf5ea8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446544 Nov 11 14:25:30.564709 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-0a51d7e4-0b91-4869-b11a-2086f05be69c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.0419378 Nov 11 14:25:30.585249 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.586318 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.586944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:30.632212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-5333e729-d6b2-4147-bc70-b9444258a1f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.633773 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-5333e729-d6b2-4147-bc70-b9444258a1f1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.0529387 Nov 11 14:25:30.671110 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-0385c139-fdaa-4a16-97c5-6bc48a4e3dce service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0285101 Nov 11 14:25:30.682900 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] Pushing event updated for resources: {'Network': ['ID=2a4362f2-7b3c-4c53-9f46-25425c5daaf7,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:30.695392 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:25:30.695883 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66bd3890-e940-4846-a5f5-b44af9b86ec2 req-0cd19cf7-0591-4c4c-9bd4-cb2e965fba6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:30.696845 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-66bd3890-e940-4846-a5f5-b44af9b86ec2 req-0cd19cf7-0591-4c4c-9bd4-cb2e965fba6a service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1098 time: 0.0925965 Nov 11 14:25:30.750904 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33692) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:30.751029 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2dafe398-8b3d-447e-8e1d-f27e0e1c917e admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7454484 Nov 11 14:25:30.758161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Request body: {'subnet': {'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1413078939-subnet', 'tenant_id': '67dc223b706f43978cc8671a6462f9d5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:30.762643 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-66bd3890-e940-4846-a5f5-b44af9b86ec2 req-cc3fe497-6b03-4e82-a8fc-b00f39238a0f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561032 Nov 11 14:25:30.794717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-1d43d4ac-9365-47d7-ae9c-99ba7064ed27 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141768 Nov 11 14:25:30.844542 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Made reservation on behalf of 67dc223b706f43978cc8671a6462f9d5 for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:30.846886 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:31.347884 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1f16d6d-6699-421e-bba9-a8a1d01b18c7 req-eded1d70-7440-4930-9a44-48fac67142b7 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3510532 Nov 11 14:25:31.357277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3617dc9-513f-4b8d-8931-ffd0a913066d req-db72a516-1f30-49b5-9b9a-786531a1c960 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:31.358774 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f3617dc9-513f-4b8d-8931-ffd0a913066d req-db72a516-1f30-49b5-9b9a-786531a1c960 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0846918 Nov 11 14:25:31.395752 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:31.455793 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f3617dc9-513f-4b8d-8931-ffd0a913066d req-7f21dd18-3e59-471b-b4ea-66b6c00f37de tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0899706 Nov 11 14:25:31.465991 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Pushing event updated for resources: {'Subnet': ['ID=65ef7658-e991-4281-b272-34a0d1d881ca,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:31.486391 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Checking segment: {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:31.488822 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Network hostable DHCP agents. Network: 2a4362f2-7b3c-4c53-9f46-25425c5daaf7, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:25:31.633232 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:25:31.669601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20911be3-d361-4a4e-b835-5e24438a237d req-7ccce3e0-c356-45a5-b039-a2bf43cbdd11 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:31.670995 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-20911be3-d361-4a4e-b835-5e24438a237d req-7ccce3e0-c356-45a5-b039-a2bf43cbdd11 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0593293 Nov 11 14:25:31.718500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 2a4362f2-7b3c-4c53-9f46-25425c5daaf7) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:31.722844 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:31.726448 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:31.727179 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-20911be3-d361-4a4e-b835-5e24438a237d req-9ffaf589-a70b-4143-b205-56d5060c6d35 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482061 Nov 11 14:25:31.728017 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20931f4e-f5ef-45e8-8564-25cf84aefb51 None None] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:31.800610 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ff232d64-60fc-4608-b6ad-1c071a46b42d admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0509672 Nov 11 14:25:31.861050 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a75d3b19-2a30-4642-9f4e-42d11d127948 None None] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:32.594562 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484c1bb5-5f15-43a9-ac45-13206118ffb1 req-fd0f8808-8bf6-414d-8902-6af11cbb7ae7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:32.595993 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-484c1bb5-5f15-43a9-ac45-13206118ffb1 req-fd0f8808-8bf6-414d-8902-6af11cbb7ae7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0548267 Nov 11 14:25:32.648011 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-484c1bb5-5f15-43a9-ac45-13206118ffb1 req-8df449dc-072d-4d5a-98b2-e9ac6c9ce47b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459692 Nov 11 14:25:32.860721 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b6f547-dd2d-4219-97d5-152d90ad1e98 req-879a4728-4708-4e3c-819c-16d5e1d35d34 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:32.862197 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f6b6f547-dd2d-4219-97d5-152d90ad1e98 req-879a4728-4708-4e3c-819c-16d5e1d35d34 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0519991 Nov 11 14:25:32.917250 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f6b6f547-dd2d-4219-97d5-152d90ad1e98 req-3c49e30e-dfe1-4a3b-ad2f-3515ce369c87 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480680 Nov 11 14:25:33.768145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75de704d-429a-4d5e-93a6-6c3259877be3 req-4c23451e-5d02-4c5a-b055-ca0596aa1a23 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:33.769581 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-75de704d-429a-4d5e-93a6-6c3259877be3 req-4c23451e-5d02-4c5a-b055-ca0596aa1a23 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0479963 Nov 11 14:25:33.816279 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-75de704d-429a-4d5e-93a6-6c3259877be3 req-67e6b70a-c0f1-49e9-afd0-c4393c7b1fe5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401273 Nov 11 14:25:34.033671 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493a9175-edb7-4f78-8953-346c141e7632 req-d7987185-289b-4b17-b632-affc45a8931a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:34.035046 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-493a9175-edb7-4f78-8953-346c141e7632 req-d7987185-289b-4b17-b632-affc45a8931a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0507729 Nov 11 14:25:34.081747 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-493a9175-edb7-4f78-8953-346c141e7632 req-0b12b619-52a5-4063-bf2f-7d528bf0caf6 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407836 Nov 11 14:25:34.932865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a5cc73-6a61-47bb-86e5-f265aa79f657 req-7a1bfe41-6fe9-4c42-854a-99ce15d2850a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:34.934326 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66a5cc73-6a61-47bb-86e5-f265aa79f657 req-7a1bfe41-6fe9-4c42-854a-99ce15d2850a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0488639 Nov 11 14:25:34.985623 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66a5cc73-6a61-47bb-86e5-f265aa79f657 req-9f7dc8d3-3303-4863-9a0c-37056457e3b9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454321 Nov 11 14:25:35.363273 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22ec091-da5e-4199-919c-10775fb83ed9 req-f467c12e-d3da-4ba6-af66-ac55f1ec4424 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:35.363273 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a22ec091-da5e-4199-919c-10775fb83ed9 req-f467c12e-d3da-4ba6-af66-ac55f1ec4424 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0553241 Nov 11 14:25:35.363273 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a22ec091-da5e-4199-919c-10775fb83ed9 req-bb62c22f-bf9f-4bf4-90cc-10452876cb26 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405307 Nov 11 14:25:36.015149 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1c6c5f29-f2e8-4391-822b-ae5ff272b3dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:36.102369 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5957a110-edd6-4f4e-b74e-944c5633b1a9 req-1527f855-1d4b-4bf9-9218-fb4e32c4d11a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:36.103831 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5957a110-edd6-4f4e-b74e-944c5633b1a9 req-1527f855-1d4b-4bf9-9218-fb4e32c4d11a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0469429 Nov 11 14:25:36.150166 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5957a110-edd6-4f4e-b74e-944c5633b1a9 req-1fbc3f8c-8e03-4e10-a6f5-7c0ea68aee5b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405273 Nov 11 14:25:36.265969 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5329c9e2-5e15-469d-b86b-d402055b3348 req-54eb46d3-ceb9-4a51-92bf-1bb93850c7b7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:36.267314 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5329c9e2-5e15-469d-b86b-d402055b3348 req-54eb46d3-ceb9-4a51-92bf-1bb93850c7b7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0507164 Nov 11 14:25:36.276011 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33794) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:36.280513 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'floatingip': {'port_id': '4c18064d-696c-4c89-af13-19525b371b78'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:36.352782 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:36.381987 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54f3eaf-d5b0-422c-b481-6251bdb2ab4b req-1b3eca93-280d-4fbc-85a5-42588406cf92 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:36.383474 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a54f3eaf-d5b0-422c-b481-6251bdb2ab4b req-1b3eca93-280d-4fbc-85a5-42588406cf92 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0521982 Nov 11 14:25:36.433318 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a54f3eaf-d5b0-422c-b481-6251bdb2ab4b req-930dfb6f-81ae-47af-ad39-6991b7dbb7b0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434003 Nov 11 14:25:37.213116 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:37.261957 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:37.360783 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Floating IP b076f550-5146-4a27-bb0d-501417a8b48e associated. External IP: 172.27.1.140, port: 4c18064d-696c-4c89-af13-19525b371b78. Nov 11 14:25:37.612140 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:25:37.621476 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45adaef-3702-4382-ad99-ceed3be5881b req-c4775763-1956-4872-b3b6-b0dce7ffa21b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:37.622914 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e45adaef-3702-4382-ad99-ceed3be5881b req-c4775763-1956-4872-b3b6-b0dce7ffa21b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0741613 Nov 11 14:25:37.749553 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e45adaef-3702-4382-ad99-ceed3be5881b req-653e5e17-53fc-4c8d-8dcb-0a7cdf3b9848 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179571 Nov 11 14:25:37.766291 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:37.775428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:37.783197 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:37.793789 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:37.794600 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:37.803529 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ddf1e098-b9b3-41ae-9453-dfa17528384d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "PUT /v2.0/floatingips/b076f550-5146-4a27-bb0d-501417a8b48e HTTP/1.1" status: 200 len: 991 time: 1.5262201 Nov 11 14:25:37.804110 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:25:37.806329 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a70381d0-473b-45fd-9eff-0ce68ad9aa45" -d '{"events": [{"name": "network-changed", "server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:25:37.850978 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:25:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0ac31f4-fe2c-4493-9b7f-24a83c8e627f x-openstack-request-id: req-e0ac31f4-fe2c-4493-9b7f-24a83c8e627f {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:25:37.850978 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:25:37.851199 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-e0ac31f4-fe2c-4493-9b7f-24a83c8e627f {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:25:37.851604 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'status': 'completed', 'code': 200} Nov 11 14:25:37.904787 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:38.171870 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'b076f550-5146-4a27-bb0d-501417a8b48e', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.140', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 319, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:25:11Z', 'updated_at': '2021-11-11T14:25:37Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:38.197539 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:25:38.208280 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:38.208280 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:38.308804 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:25:38.402109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-72cedd1a-2574-4202-9905-8f77d492a5b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:38.403843 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-72cedd1a-2574-4202-9905-8f77d492a5b6 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1098 time: 0.0462456 Nov 11 14:25:38.438899 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a8c5e95b-9741-4e77-9a3a-d178c87ce206 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:38.512642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-315a4e6f-3878-40e2-9da3-dae865129479 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:38.514190 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-315a4e6f-3878-40e2-9da3-dae865129479 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0937746 Nov 11 14:25:38.550755 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'b076f550-5146-4a27-bb0d-501417a8b48e', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.140', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 319, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:25:11Z', 'updated_at': '2021-11-11T14:25:37Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:38.577824 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72ba592-7b50-430e-8a5c-5eba730b6664 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'b076f550-5146-4a27-bb0d-501417a8b48e', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.140', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 319, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:25:11Z', 'updated_at': '2021-11-11T14:25:37Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:25:38.618515 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-143d8217-03a6-4579-adc6-fbdcdd550321 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 999 time: 0.0946031 Nov 11 14:25:38.679459 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-0f8d0f57-038f-406a-9ba8-3daf2e91d4ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:38.683069 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-0f8d0f57-038f-406a-9ba8-3daf2e91d4ec service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0511873 Nov 11 14:25:38.745057 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-066e5579-3f24-4236-8e21-ce5ee7a93205 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:38.746548 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-066e5579-3f24-4236-8e21-ce5ee7a93205 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0521131 Nov 11 14:25:38.805759 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b3d592d-727d-46e8-b91e-cca7140e3b81 None None] New status for floating IP b076f550-5146-4a27-bb0d-501417a8b48e: ACTIVE {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:25:38.861896 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-652770cc-0564-41b8-9433-482ffea71e96 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0987992 Nov 11 14:25:38.888983 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0d92be-9af0-48d9-96e8-a0da921ed98e req-f43a61c3-0ca3-45db-8bec-9fb5c86ba663 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:38.891385 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb0d92be-9af0-48d9-96e8-a0da921ed98e req-f43a61c3-0ca3-45db-8bec-9fb5c86ba663 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0638332 Nov 11 14:25:38.942176 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb0d92be-9af0-48d9-96e8-a0da921ed98e req-a0b43680-9bcc-470d-a8d0-792ef47a8c9a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449917 Nov 11 14:25:39.616225 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:40.059019 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d95d1-841c-4f1f-9bc6-963b336b1d57 req-d1accf64-88e4-4d36-97e9-26fac4326dca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:40.060632 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-690d95d1-841c-4f1f-9bc6-963b336b1d57 req-d1accf64-88e4-4d36-97e9-26fac4326dca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0487499 Nov 11 14:25:40.113090 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-690d95d1-841c-4f1f-9bc6-963b336b1d57 req-066bdc69-78e7-4119-81c2-074320750d41 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468209 Nov 11 14:25:40.742038 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:41.232539 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c892a28-115f-4a4b-865a-c4704eb117f1 req-d6f5fdd2-8c1b-462a-a67f-0b5fb307c801 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:41.234069 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0c892a28-115f-4a4b-865a-c4704eb117f1 req-d6f5fdd2-8c1b-462a-a67f-0b5fb307c801 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0523448 Nov 11 14:25:41.287379 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0c892a28-115f-4a4b-865a-c4704eb117f1 req-dfc2262f-c412-447c-9865-a1f4c307f71d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473032 Nov 11 14:25:41.679437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:42.038925 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:42.076840 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a70381d0-473b-45fd-9eff-0ce68ad9aa45 req-b73757da-3f3d-4a50-a39b-bd81e4b214f7 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872164 Nov 11 14:25:42.407726 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd9e498-1c3a-4632-a9c0-2c34923668f0 req-d939f071-f19b-4ae0-bbd2-34e2fcdd1e74 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:42.409209 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-efd9e498-1c3a-4632-a9c0-2c34923668f0 req-d939f071-f19b-4ae0-bbd2-34e2fcdd1e74 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0516837 Nov 11 14:25:42.457200 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-efd9e498-1c3a-4632-a9c0-2c34923668f0 req-3b6028e0-0605-4b5e-8913-f52f3e7ba161 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416033 Nov 11 14:25:43.576535 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5045b0fa-0ba4-42aa-a96c-7c99c99787a0 req-3f083c43-de1c-4980-8082-62046274538c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:43.577948 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5045b0fa-0ba4-42aa-a96c-7c99c99787a0 req-3f083c43-de1c-4980-8082-62046274538c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0494502 Nov 11 14:25:43.629206 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5045b0fa-0ba4-42aa-a96c-7c99c99787a0 req-301543d8-990a-4048-af8f-b9c320a313cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440185 Nov 11 14:25:43.903534 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-1559a1e9-0886-4603-9ef9-4fa53d0c7121 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:43.905065 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-1559a1e9-0886-4603-9ef9-4fa53d0c7121 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.0412657 Nov 11 14:25:44.015306 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-c99a9bd3-c770-4443-a6b5-0be77bbaeacf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:44.016926 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-c99a9bd3-c770-4443-a6b5-0be77bbaeacf service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.0935769 Nov 11 14:25:44.060619 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-331163e8-bc1e-4dd0-9747-85943c656e9f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.0348022 Nov 11 14:25:44.113293 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-b8d7060e-da83-48dc-9c79-80773a1059ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:44.115253 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-b8d7060e-da83-48dc-9c79-80773a1059ca service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.0468123 Nov 11 14:25:44.150244 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-0b42d648-cc03-4526-a636-f10c8dc514a8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279164 Nov 11 14:25:44.710049 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33960) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:44.855073 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:44.927317 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:44.991969 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.028446 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25eba1a4-1799-4154-abd3-596caec39cca,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:45.032882 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=67b43bfdba674191a01527028cc3efe2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3212769 Nov 11 14:25:45.035781 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33966) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:45.037585 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.037921 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.038257 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.038573 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.038890 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.039211 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.039553 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.039870 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.040183 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.040494 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.040807 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.041114 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1bdd34b-9ad8-428b-a710-0551d4cecc65 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.082770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.104126 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.216344 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.218979 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.220158 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/25eba1a4-1799-4154-abd3-596caec39cca HTTP/1.1" status: 204 len: 168 time: 0.1833882 Nov 11 14:25:45.230314 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25eba1a4-1799-4154-abd3-596caec39cca,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:45.235711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.236064 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.236406 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.236904 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.237150 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.237493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.237815 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.238142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.238469 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.238792 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.239109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.239450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fd32d23-2b94-4654-9e1f-fb7ee14f3406 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:45.357820 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-51793eda-b1ab-43ad-8158-7c04ba78ddc0 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904241 Nov 11 14:25:45.579833 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 33976) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:45.746542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c7b024c8-5bf1-471a-9434-659052316a77 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.827396 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c7b024c8-5bf1-471a-9434-659052316a77 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.918580 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c7b024c8-5bf1-471a-9434-659052316a77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:45.962128 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c7b024c8-5bf1-471a-9434-659052316a77 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=03536c47543a42048dab6d7f64e8d357&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3812115 Nov 11 14:25:45.963663 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b024c8-5bf1-471a-9434-659052316a77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=858bd0f0-8c36-4b74-b61c-a49b3f885a6c,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:45.965471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33984) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:46.024570 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.050912 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.153407 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.156107 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.157268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/858bd0f0-8c36-4b74-b61c-a49b3f885a6c HTTP/1.1" status: 204 len: 168 time: 0.1908164 Nov 11 14:25:46.165984 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d7d3b1b-c37c-4f8c-9cb4-6703825076eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=858bd0f0-8c36-4b74-b61c-a49b3f885a6c,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:46.775314 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33992) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:46.788945 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-716c1025-8c0d-4f56-85ee-100f2e081882 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.862761 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-716c1025-8c0d-4f56-85ee-100f2e081882 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.934845 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-716c1025-8c0d-4f56-85ee-100f2e081882 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:46.975078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c1025-8c0d-4f56-85ee-100f2e081882 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01eaeead-d6a8-4c63-8f50-360d16173b20,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:46.979872 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-716c1025-8c0d-4f56-85ee-100f2e081882 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=9dcd2d76d62349f69f98789a44bc96ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2034822 Nov 11 14:25:46.982450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 33998) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:47.028106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:47.048553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:47.198755 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:47.202320 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:47.203719 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/01eaeead-d6a8-4c63-8f50-360d16173b20 HTTP/1.1" status: 204 len: 168 time: 0.2202845 Nov 11 14:25:47.223732 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d047d75-cb50-449c-8dc2-a011ec410f50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01eaeead-d6a8-4c63-8f50-360d16173b20,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:47.311672 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f630d37e-6bd4-4deb-a593-40a67dd0d639 req-489ddbc1-e8a0-4b07-8ded-0bc8220b5854 service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0976856 Nov 11 14:25:47.364227 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc28d316-2b9e-453e-bbd4-e5fb8d6228cc req-a0581f4e-7b90-471b-9add-6342180bd631 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:47.365764 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dc28d316-2b9e-453e-bbd4-e5fb8d6228cc req-a0581f4e-7b90-471b-9add-6342180bd631 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0575829 Nov 11 14:25:47.417872 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dc28d316-2b9e-453e-bbd4-e5fb8d6228cc req-3c529546-ad19-4391-ba2b-be201465dfe2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454307 Nov 11 14:25:48.541239 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb73f50-353d-4b8b-bdf0-25d54362f228 req-a2a4f47b-580a-473b-a93b-e5281a099af7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:48.542737 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebb73f50-353d-4b8b-bdf0-25d54362f228 req-a2a4f47b-580a-473b-a93b-e5281a099af7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0509627 Nov 11 14:25:48.591896 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebb73f50-353d-4b8b-bdf0-25d54362f228 req-b5bd617c-fe89-4b46-b19c-57af591c0845 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431881 Nov 11 14:25:49.719191 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8581061c-3cb4-4c75-9c92-05f1c3d09cc9 req-5ab67a90-5329-4bcf-a353-21cc862f1c6f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:49.723902 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8581061c-3cb4-4c75-9c92-05f1c3d09cc9 req-5ab67a90-5329-4bcf-a353-21cc862f1c6f tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0587888 Nov 11 14:25:49.772462 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8581061c-3cb4-4c75-9c92-05f1c3d09cc9 req-3b91bc45-1d88-4c0d-8c6b-54c6c3259d7a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447495 Nov 11 14:25:50.919016 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a58748-49da-474e-888a-1d661339968a req-fc7f4868-a87f-418d-b3c5-8acb9029c714 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:50.925696 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-00a58748-49da-474e-888a-1d661339968a req-fc7f4868-a87f-418d-b3c5-8acb9029c714 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0582767 Nov 11 14:25:50.970229 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-00a58748-49da-474e-888a-1d661339968a req-427d8fa0-a934-48f6-a6e2-8a2090b1fb05 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435071 Nov 11 14:25:52.099449 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67ad515-9e65-4e9b-a9b6-f40371dd7bfc req-a21e9969-d96d-4148-ac87-aa229f553217 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:52.101562 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a67ad515-9e65-4e9b-a9b6-f40371dd7bfc req-a21e9969-d96d-4148-ac87-aa229f553217 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0517728 Nov 11 14:25:52.161692 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a67ad515-9e65-4e9b-a9b6-f40371dd7bfc req-c0f7edc1-c92f-4fff-9856-17456af1840d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537229 Nov 11 14:25:53.244941 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-12b5cd74-d390-422c-81ec-e662d19c1560 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:53.246473 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-12b5cd74-d390-422c-81ec-e662d19c1560 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/networks?id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7 HTTP/1.1" status: 200 len: 814 time: 0.1064534 Nov 11 14:25:53.265500 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-eff02c37-17a0-4a29-bfc5-d71b29250956 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/quotas/67dc223b706f43978cc8671a6462f9d5 HTTP/1.1" status: 200 len: 375 time: 0.0105495 Nov 11 14:25:53.292165 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ca20cf1-6bce-474b-9de5-a75eca4f8efb req-98bb874c-6b20-4c32-8bff-dd040b0d5b86 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:53.293805 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5ca20cf1-6bce-474b-9de5-a75eca4f8efb req-98bb874c-6b20-4c32-8bff-dd040b0d5b86 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0596917 Nov 11 14:25:53.326502 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-231e1f0a-41e5-4912-b6e8-23ce37961b78 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0544310 Nov 11 14:25:53.354753 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:25:53.362878 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5ca20cf1-6bce-474b-9de5-a75eca4f8efb req-206426c0-9996-4210-9919-b9f0d6269bcc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608292 Nov 11 14:25:53.478428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-e42e34b8-ad28-44ee-b92d-d84b04ad8d82 service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:25:53.479469 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-e42e34b8-ad28-44ee-b92d-d84b04ad8d82 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0469186 Nov 11 14:25:53.772416 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-d255f3dd-398d-424f-ba8f-daab5fa8fda8 service neutron] 10.222.0.10 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2866256 Nov 11 14:25:53.805138 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34224) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:53.887020 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-5766463b-4f47-4327-a0ec-e6a4923f50ca service neutron] 10.222.0.10 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1025405 Nov 11 14:25:53.912613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8a4d-a217-433d-b323-6fcfbc04468a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:53.984510 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8a4d-a217-433d-b323-6fcfbc04468a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.072871 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8a4d-a217-433d-b323-6fcfbc04468a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.114169 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ae3e8a4d-a217-433d-b323-6fcfbc04468a admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=026a8aff2ab044589beba3f3520cffda&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3054421 Nov 11 14:25:54.114525 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3e8a4d-a217-433d-b323-6fcfbc04468a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d387a0a-2ec7-47cd-b57f-ddd71a00cbef,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:54.114659 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34242) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:54.174014 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.229590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.268577 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ec44f012-d1a3-4ca5-9a4a-c3504f7dab31 req-999e5ce1-9ffe-4d37-9fc8-4a13502e4607 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 210 time: 0.0339763 Nov 11 14:25:54.448609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.451191 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.452329 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/5d387a0a-2ec7-47cd-b57f-ddd71a00cbef HTTP/1.1" status: 204 len: 168 time: 0.3366008 Nov 11 14:25:54.466357 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e1aaf9-8dcc-4565-8d22-4497f3fcef24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d387a0a-2ec7-47cd-b57f-ddd71a00cbef,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:54.484527 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0571268-1918-4c96-b548-3ef6d8adbabd req-b0b330cf-a0e9-414e-b23d-0f8062c41195 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:54.486053 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0571268-1918-4c96-b548-3ef6d8adbabd req-b0b330cf-a0e9-414e-b23d-0f8062c41195 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0632739 Nov 11 14:25:54.540536 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0571268-1918-4c96-b548-3ef6d8adbabd req-cab5ac94-d802-4c09-a6aa-ad6980af3883 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486062 Nov 11 14:25:54.696047 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34268) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:54.834529 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2e3dd5b5-30bc-4edb-8be9-1947df348c2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:54.925010 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2e3dd5b5-30bc-4edb-8be9-1947df348c2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.028659 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-2e3dd5b5-30bc-4edb-8be9-1947df348c2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.066263 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e3dd5b5-30bc-4edb-8be9-1947df348c2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3c91105-f118-4c35-a859-9cd665e1a5c1,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:55.070985 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2e3dd5b5-30bc-4edb-8be9-1947df348c2e admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=66150a9d050f41a0994737ffefdd169f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3739054 Nov 11 14:25:55.073997 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34294) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:55.139813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.161007 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.250042 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.252852 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.254416 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/e3c91105-f118-4c35-a859-9cd665e1a5c1 HTTP/1.1" status: 204 len: 168 time: 0.1787488 Nov 11 14:25:55.267069 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36dd6d8-afcf-48b0-ace5-6ea282afd159 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3c91105-f118-4c35-a859-9cd665e1a5c1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:55.372976 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-12eb9bcf-d9a8-4c79-8d0e-a1d162164279 req-26da3976-f597-4a44-bd43-68f0a582a25b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 210 time: 0.0328159 Nov 11 14:25:55.508667 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34310) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:55.667701 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2732fc4f-abf9-4f06-a62a-f46a7a8a288f req-ea437901-e825-4393-9e71-632cb2933375 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:55.671835 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2732fc4f-abf9-4f06-a62a-f46a7a8a288f req-ea437901-e825-4393-9e71-632cb2933375 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0615392 Nov 11 14:25:55.720466 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-805180888-network', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:55.732876 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2732fc4f-abf9-4f06-a62a-f46a7a8a288f req-ec25795e-2510-4ab5-bfae-61d23bef6bd4 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579233 Nov 11 14:25:55.810419 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Made reservation on behalf of 43dc465eb95943ee921d1e983a7e0320 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:55.812758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.821745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.895328 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:55.988752 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34322) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:55.996693 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.014363 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-35b341dc-e0c5-4b32-869b-469bca9584c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.033018 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 332} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:25:56.049695 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca12ff19-a5ee-463e-88da-8321437b44a1,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:56.057818 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.058155 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Added segment e4a3441b-73d8-49a9-8956-724958d2a291 of type vlan for network 974515c5-e282-45f9-84fa-971ce619e2ed Nov 11 14:25:56.108660 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.160824 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-35b341dc-e0c5-4b32-869b-469bca9584c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.209656 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.211114 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:56.211737 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.240564 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-35b341dc-e0c5-4b32-869b-469bca9584c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.290272 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] Pushing event updated for resources: {'Network': ['ID=974515c5-e282-45f9-84fa-971ce619e2ed,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:56.302106 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 974515c5-e282-45f9-84fa-971ce619e2ed details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:25:56.311650 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b9ed9826-595b-4b92-b418-d71eaf2b5ef6 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8018470 Nov 11 14:25:56.311870 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34326) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:56.316445 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-35b341dc-e0c5-4b32-869b-469bca9584c9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=33eaa609983c45c79a9a4c83ade5f5bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3266873 Nov 11 14:25:56.317247 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b341dc-e0c5-4b32-869b-469bca9584c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39e3a585-2296-42d0-9611-62040e90c531,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:56.320053 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34328) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:56.320742 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Request body: {'subnet': {'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-805180888-subnet', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:56.380118 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.392906 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Made reservation on behalf of 43dc465eb95943ee921d1e983a7e0320 for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:56.395233 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.403652 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.506789 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-15c440e7-4088-45ae-b64f-49d3c5974e01 req-07bbe9eb-9447-4185-87d1-11fe29d7c023 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 210 time: 0.0292363 Nov 11 14:25:56.530329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.533025 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.540094 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/39e3a585-2296-42d0-9611-62040e90c531 HTTP/1.1" status: 204 len: 168 time: 0.2131734 Nov 11 14:25:56.543148 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f44876-5f11-43f0-b88d-82198e8684e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39e3a585-2296-42d0-9611-62040e90c531,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:56.705700 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-f999b6f5-1c3a-4857-a6a7-eb4b90de6af5 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:56.707300 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-f999b6f5-1c3a-4857-a6a7-eb4b90de6af5 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "GET /v2.0/networks?id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7 HTTP/1.1" status: 200 len: 814 time: 0.1028996 Nov 11 14:25:56.723668 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Request body: {'port': {'device_id': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7', 'admin_state_up': True, 'tenant_id': '67dc223b706f43978cc8671a6462f9d5'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:56.765064 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.836498 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7c279c15-72b2-4ea5-aa18-273542134660,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:56.856154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Checking segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:56.856479 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Network hostable DHCP agents. Network: 974515c5-e282-45f9-84fa-971ce619e2ed, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:25:56.908648 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5080da-b668-4121-bc01-ef8a5a6e31e9 req-85ddadda-8522-4ada-9dc9-c9ee8f454a96 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:56.910252 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f5080da-b668-4121-bc01-ef8a5a6e31e9 req-85ddadda-8522-4ada-9dc9-c9ee8f454a96 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0704648 Nov 11 14:25:56.936643 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Made reservation on behalf of 67dc223b706f43978cc8671a6462f9d5 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:25:56.941770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:56.967151 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f5080da-b668-4121-bc01-ef8a5a6e31e9 req-77c7a6fa-543f-4cfa-a82b-76c88eecc6f2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491903 Nov 11 14:25:56.971022 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Network 974515c5-e282-45f9-84fa-971ce619e2ed is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:25:57.073514 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 974515c5-e282-45f9-84fa-971ce619e2ed) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:57.078460 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:57.079126 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.083296 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-790507b9-3eed-4318-a98a-1ab65f55780f None None] Network 974515c5-e282-45f9-84fa-971ce619e2ed requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:57.107645 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Allocated IP 172.20.0.6 (2a4362f2-7b3c-4c53-9f46-25425c5daaf7/65ef7658-e991-4281-b272-34a0d1d881ca/9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:57.207427 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d732980b-6a58-4758-9988-ab84c4ddfdf0 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.8939071 Nov 11 14:25:57.210717 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34346) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:57.215639 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:57.247947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-974515c5-e282-45f9-84fa-971ce619e2ed', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:25:57.249826 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.270914 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.277984 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34348) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:57.291725 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.292872 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.296082 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-75b2f6c9-a3a8-4a82-ba49-2509a3b3779d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.369163 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.376716 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.416418 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Allocated IP 172.20.0.2 (974515c5-e282-45f9-84fa-971ce619e2ed/7c279c15-72b2-4ea5-aa18-273542134660/7bf74962-e971-4f49-bb81-dbf9b7f1ff23) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:57.417971 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-75b2f6c9-a3a8-4a82-ba49-2509a3b3779d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.422082 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:57.439278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:57.439278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:57.484430 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:57.485034 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.500042 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Pushing event updated for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:57.525215 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-75b2f6c9-a3a8-4a82-ba49-2509a3b3779d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.565122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.589974 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-a92b2e78-51e9-49b0-bed4-a6eb5629a29b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8699043 Nov 11 14:25:57.595621 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-75b2f6c9-a3a8-4a82-ba49-2509a3b3779d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=2eea80e844e947b0a811518f5ec8fe50&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3164444 Nov 11 14:25:57.599801 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34354) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:57.615159 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Request body: {'port': {'device_id': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:25:57.643891 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.661657 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75b2f6c9-a3a8-4a82-ba49-2509a3b3779d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bae8367d-d6ab-41ce-91e3-0b7118c04b61,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:57.686275 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c89545-9f7e-4f00-bedb-bb6d8c37f2cb req-73508e1c-8479-47fe-97a0-041ac129f7e6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:57.687785 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-81c89545-9f7e-4f00-bedb-bb6d8c37f2cb req-73508e1c-8479-47fe-97a0-041ac129f7e6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 931 time: 0.0857198 Nov 11 14:25:57.692814 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.697457 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.714003 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.740544 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-81c89545-9f7e-4f00-bedb-bb6d8c37f2cb req-f2221ace-4b43-4442-ada8-7aeeb7883ee9 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463529 Nov 11 14:25:57.750442 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.760339 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Network 974515c5-e282-45f9-84fa-971ce619e2ed is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:57.765795 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:57.769181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:57.779661 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Pushing event updated for resources: {'Port': ['ID=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:57.807869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.808392 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.808835 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.809261 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.809699 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.810124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.810544 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.810980 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.811436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.811855 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.812277 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.812688 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:25:57.842264 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Attempting to bind port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:57.842627 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Attempting to bind port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:57.842987 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Attempting to bind port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 on network 974515c5-e282-45f9-84fa-971ce619e2ed {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:57.848159 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:57.850869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Checking segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:57.850869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.850869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Bound using segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:57.850869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Bound port: 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:57.850869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.918282 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] For port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:57.921494 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] For port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:57.926129 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.929312 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:57.930406 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/bae8367d-d6ab-41ce-91e3-0b7118c04b61 HTTP/1.1" status: 204 len: 168 time: 0.3313193 Nov 11 14:25:57.944736 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f74195-eb8e-4e4b-90d4-5abdf4d45fd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bae8367d-d6ab-41ce-91e3-0b7118c04b61,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:57.986385 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.006158 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.042410 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.069493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:25:58.078530 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.091641 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed05d752-998b-4a83-bf04-986d28f71fb1 None None] Pushing event updated for resources: {'Port': ['ID=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:58.102550 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Transition to ACTIVE for port object 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:25:58.144347 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba25858-4611-443d-8dbe-9663f82fa0de req-d65802ac-9882-4488-a289-9819e6b664e9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.145855 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fba25858-4611-443d-8dbe-9663f82fa0de req-d65802ac-9882-4488-a289-9819e6b664e9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0574095 Nov 11 14:25:58.171119 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.211640 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Allocated IP 172.27.1.54 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/fd57231c-3882-4ca8-9947-76ba90b2197b) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:25:58.248452 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fba25858-4611-443d-8dbe-9663f82fa0de req-8ec345dd-e128-4c0a-89d7-dafc9d31c681 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955610 Nov 11 14:25:58.254837 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Pushing event updated for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:58.363954 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.365460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Attempting to bind port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:25:58.365460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Attempting to bind port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:25:58.365460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Attempting to bind port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:58.370130 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:25:58.370464 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Attempting to bind port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:25:58.375613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:25:58.375950 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Checking segment: {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:25:58.376330 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Bound using segment: {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:25:58.376753 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Bound port: 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:25:58.377108 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.467591 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.486674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:25:58.490104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:25:58.511982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:25:58.514837 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:25:58.521267 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:25:58.555051 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.584643 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Pushing event updated for resources: {'Port': ['ID=fd57231c-3882-4ca8-9947-76ba90b2197b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:58.587404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.588086 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.589453 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] 10.222.0.11 "PUT /v2.0/ports/9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 HTTP/1.1" status: 200 len: 1093 time: 0.9832318 Nov 11 14:25:58.589892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:25:58.592168 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc12ae52-5658-49e0-ac68-11ef52db6844" -d '{"events": [{"name": "network-changed", "server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:25:58.639133 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ff387c-042c-4340-ad56-f85662db7582 service neutron] Pushing event updated for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:58.650000 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:25:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fc33dbe-40f0-45d6-8656-a0e59fb46c1b x-openstack-request-id: req-7fc33dbe-40f0-45d6-8656-a0e59fb46c1b {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:25:58.650410 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:25:58.650758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-7fc33dbe-40f0-45d6-8656-a0e59fb46c1b {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:25:58.651212 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0', 'status': 'completed', 'code': 200} Nov 11 14:25:58.713531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-b0d207de-01f3-47a7-a48b-36039da908ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.715022 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-b0d207de-01f3-47a7-a48b-36039da908ad service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 1096 time: 0.0419307 Nov 11 14:25:58.832970 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-eecbbbb5-9807-4ed3-b5cf-0dcd40331fd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.845578 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-eecbbbb5-9807-4ed3-b5cf-0dcd40331fd4 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=67dc223b706f43978cc8671a6462f9d5&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1126945 Nov 11 14:25:58.912345 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:58.962419 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca00fdcb-d026-4a58-9667-ce2541ffee79 req-aa585abc-78f6-4035-be8a-6296afc64f35 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.964198 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ca00fdcb-d026-4a58-9667-ce2541ffee79 req-aa585abc-78f6-4035-be8a-6296afc64f35 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 943 time: 0.1058488 Nov 11 14:25:58.970865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-5f5aac17-9463-4656-9fb0-a6c11ad29276 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:58.972271 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fc12ae52-5658-49e0-ac68-11ef52db6844 req-5f5aac17-9463-4656-9fb0-a6c11ad29276 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1293352 Nov 11 14:25:59.138441 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ca00fdcb-d026-4a58-9667-ce2541ffee79 req-edb71109-4667-467b-94b2-495a8ebba227 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861948 Nov 11 14:25:59.138537 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-63a3214b-0288-4328-93b0-13e5558cd4d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:59.138537 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-63a3214b-0288-4328-93b0-13e5558cd4d4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 1096 time: 0.0530114 Nov 11 14:25:59.187668 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.210890 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af7bf45b-ee40-4eb4-89a3-e8e66bd0bb0f None None] Network 974515c5-e282-45f9-84fa-971ce619e2ed requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:25:59.375763 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] Provisioning complete for port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:59.375763 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.380341 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-b4cbb2a7-b837-4481-8af6-bb044884cad2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 HTTP/1.1" status: 200 len: 217 time: 0.3035078 Nov 11 14:25:59.484939 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a716525-d856-4c9f-be79-a37263862c44 req-36a30116-2eac-47c7-9894-19b9d66c5dd0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:59.492713 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a716525-d856-4c9f-be79-a37263862c44 req-36a30116-2eac-47c7-9894-19b9d66c5dd0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1081431 Nov 11 14:25:59.504450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-d717c380-65fc-47c8-a8de-1dbf2fe80bfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:25:59.505893 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-d717c380-65fc-47c8-a8de-1dbf2fe80bfd service neutron] 10.222.0.11 "GET /v2.0/subnets?id=65ef7658-e991-4281-b272-34a0d1d881ca HTTP/1.1" status: 200 len: 854 time: 0.1106503 Nov 11 14:25:59.510388 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.553306 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-f38ff9ce-175b-42bf-933d-12d224b5ce1c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0358336 Nov 11 14:25:59.563469 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] For port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:25:59.617122 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a716525-d856-4c9f-be79-a37263862c44 req-f598fc6f-a9bc-4cb7-89a7-dab07126503d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233871 Nov 11 14:25:59.623068 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Router fb1030fc-a673-40f8-8acc-5812ce724bec is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:25:59.676709 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-2419ab85-6f2e-4a91-9a45-9904cede812f service neutron] 10.222.0.11 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1117280 Nov 11 14:25:59.730307 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.744440 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:25:59.756254 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Sync routers for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:25:59.781971 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:25:59.781971 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:25:59.782365 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28bfad2a-c1ff-4b5c-898e-e455fe16da90 req-27072622-9735-41ed-a225-fff4f9b54033 service neutron] 10.222.0.11 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956888 Nov 11 14:25:59.812453 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98fb1da8-344e-4d59-aadc-3283a1705c46 None None] Pushing event updated for resources: {'Port': ['ID=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:25:59.853743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-3c60b97e-5f82-4ad9-812d-abc6c70dd5f9 None None] Provisioning complete for port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:25:59.854110 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3c60b97e-5f82-4ad9-812d-abc6c70dd5f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.892569 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:25:59.893850 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c700aaf5-02bf-44a9-80d1-b5ba33c4a43a admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.6820197 Nov 11 14:25:59.895788 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:25:59.904123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34400) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:25:59.919246 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:00.118731 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:00.119839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.223941 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:25:58Z', 'revision_number': 3, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:25:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:00.253386 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Checking router: fb1030fc-a673-40f8-8acc-5812ce724bec for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:00.253990 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Updating router fb1030fc-a673-40f8-8acc-5812ce724bec port fd57231c-3882-4ca8-9947-76ba90b2197b binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:26:00.288781 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.550353 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18ef8ca-5784-4a02-91e5-93eda1d0d062 req-e8032582-713f-49db-9bab-25b5c029d7c6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:00.551882 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c18ef8ca-5784-4a02-91e5-93eda1d0d062 req-e8032582-713f-49db-9bab-25b5c029d7c6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 943 time: 0.3142467 Nov 11 14:26:00.605744 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.654842 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c18ef8ca-5784-4a02-91e5-93eda1d0d062 req-f8e0d034-10c4-4e90-94a7-581e82b2253f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932186 Nov 11 14:26:00.696175 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.699461 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.761318 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f741c63-2bee-4c94-bc55-361dcea1e3f6 None None] Pushing event updated for resources: {'Port': ['ID=fd57231c-3882-4ca8-9947-76ba90b2197b,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:00.774923 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fac236f-ca9e-4441-b0ad-0305e00f2fb4 req-e05b954f-1a9e-47e2-bbf9-8628434c0e03 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:00.776742 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5fac236f-ca9e-4441-b0ad-0305e00f2fb4 req-e05b954f-1a9e-47e2-bbf9-8628434c0e03 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0637457 Nov 11 14:26:00.777025 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Attempting to bind port fd57231c-3882-4ca8-9947-76ba90b2197b on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:00.777406 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Attempting to bind port fd57231c-3882-4ca8-9947-76ba90b2197b by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:00.778729 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Attempting to bind port fd57231c-3882-4ca8-9947-76ba90b2197b on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:00.783693 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:00.784291 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:00.784834 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.785339 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:00.785860 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Bound port: fd57231c-3882-4ca8-9947-76ba90b2197b, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:00.786367 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.841175 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] For port fd57231c-3882-4ca8-9947-76ba90b2197b, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:00.846501 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] For port fd57231c-3882-4ca8-9947-76ba90b2197b, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=fd57231c-3882-4ca8-9947-76ba90b2197b,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:00.847629 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5fac236f-ca9e-4441-b0ad-0305e00f2fb4 req-1559050b-90c1-49f8-9982-b735e5e86654 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618608 Nov 11 14:26:00.882013 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Allocated IP 172.20.0.1 (974515c5-e282-45f9-84fa-971ce619e2ed/7c279c15-72b2-4ea5-aa18-273542134660/b97f6646-ee4c-4dac-9a61-7b951a205fbf) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:00.914298 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:00.969978 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:00.970579 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:00.987549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.007093 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f741c63-2bee-4c94-bc55-361dcea1e3f6 None None] Pushing event updated for resources: {'Port': ['ID=fd57231c-3882-4ca8-9947-76ba90b2197b,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:01.079620 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:01.084198 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.120661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Network 974515c5-e282-45f9-84fa-971ce619e2ed is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:01.127287 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:01.130918 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:01.131513 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.183763 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Pushing event updated for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:01.285449 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:25:58Z', 'revision_number': 3, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:01.313931 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034eddae-77ee-41a7-861a-db6dc1d04e0d None None] The sync data for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi is: [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:25:58Z', 'revision_number': 3, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:01.355027 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.428075 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-5336c3c5-a035-4564-bd9d-1292869a7316 None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:01.429096 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5336c3c5-a035-4564-bd9d-1292869a7316 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.476753 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-5336c3c5-a035-4564-bd9d-1292869a7316 None None] Port b97f6646-ee4c-4dac-9a61-7b951a205fbf cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:01.530947 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.610596 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.611594 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:01.698446 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Pushing event updated for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:01.790728 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Network 974515c5-e282-45f9-84fa-971ce619e2ed is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:01.792661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:01.848214 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2fd5c9-0d8b-4882-9530-20e728539614 req-56ad6853-c323-4cab-a5ea-474a0056208f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:01.851485 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0a2fd5c9-0d8b-4882-9530-20e728539614 req-56ad6853-c323-4cab-a5ea-474a0056208f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 943 time: 0.0837755 Nov 11 14:26:01.868092 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:26:01.995130 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0a2fd5c9-0d8b-4882-9530-20e728539614 req-d23c48d0-54e3-41b5-a5f5-704d7c685bed tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1371047 Nov 11 14:26:02.063777 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Router fb1030fc-a673-40f8-8acc-5812ce724bec has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:26:02.090927 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:02.098868 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:02.142740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0', 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7', 'port_id': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0', 'mac_address': 'fa:16:3e:fd:33:f9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 305, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65ef7658-e991-4281-b272-34a0d1d881ca', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:26:02.164921 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04abdf45-80a6-4c0e-8dc7-559de760a0cd req-ca432259-ed81-4ee1-b274-591e9bf01edc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:02.166848 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-04abdf45-80a6-4c0e-8dc7-559de760a0cd req-ca432259-ed81-4ee1-b274-591e9bf01edc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1526356 Nov 11 14:26:02.196978 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.209051 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:02.209445 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.239681 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:26:02.250203 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-1eedbc26-c9da-4c89-a14d-1eb78e35c0e5 None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:02.250566 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1eedbc26-c9da-4c89-a14d-1eb78e35c0e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.272985 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:26:02.278597 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d690e821-1229-4277-a555-bb2698682aa9 admin admin] 10.222.0.10 "PUT /v2.0/routers/fb1030fc-a673-40f8-8acc-5812ce724bec/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3734438 Nov 11 14:26:02.286877 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-04abdf45-80a6-4c0e-8dc7-559de760a0cd req-7905bd58-1cfc-4ee0-9ff4-9f7e264cf85b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657740 Nov 11 14:26:02.308516 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:02.328237 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-1eedbc26-c9da-4c89-a14d-1eb78e35c0e5 None None] Port b97f6646-ee4c-4dac-9a61-7b951a205fbf cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:02.370629 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device fd57231c-3882-4ca8-9947-76ba90b2197b up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:02.408691 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.494331 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:02.504842 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port fd57231c-3882-4ca8-9947-76ba90b2197b triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:02.505216 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.653134 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:26:02.658699 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.710412 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port fd57231c-3882-4ca8-9947-76ba90b2197b, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=fd57231c-3882-4ca8-9947-76ba90b2197b,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:02.738943 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-caa1fd26-f568-441e-b3ad-81b69bf6e6e1 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1062906159&fields=id&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 267 time: 0.0670619 Nov 11 14:26:02.795587 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:02.866340 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b7f305bd-0fbe-4896-bd4e-23955b75a4be tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:02.866340 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b7f305bd-0fbe-4896-bd4e-23955b75a4be tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1252160 Nov 11 14:26:02.882428 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-9329c26b-e04c-4340-9813-a8111bc2f693 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/quotas/2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 375 time: 0.0091026 Nov 11 14:26:02.884077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=fd57231c-3882-4ca8-9947-76ba90b2197b,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:02.935155 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-e6b2086f-63e9-4aa0-a489-9b23d8d36ae5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0470238 Nov 11 14:26:03.061168 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-9d05dcd3-09f2-4311-8784-97e7fe142f88 service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1104946 Nov 11 14:26:03.124437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b0ed7b-a355-440e-be36-3addd3eea063 req-25d1eef0-ba87-4cfa-8dc8-97de6366cf53 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:03.126033 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d9b0ed7b-a355-440e-be36-3addd3eea063 req-25d1eef0-ba87-4cfa-8dc8-97de6366cf53 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 944 time: 0.0525022 Nov 11 14:26:03.168245 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-8362f66a-6975-45fa-b4de-b3703aef3231 service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1094003 Nov 11 14:26:03.200214 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d9b0ed7b-a355-440e-be36-3addd3eea063 req-cb790905-af69-49cd-9540-25309af9baa5 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661395 Nov 11 14:26:03.263761 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34486) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:03.268735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-221554170-network', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:03.341171 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Made reservation on behalf of 52b6cc5d3c34431399cfdc162f14356f for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:03.343413 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.355865 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.441074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Sync routers for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:26:03.451297 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:03.451956 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:03.452675 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63573e85-7feb-4b93-9933-8c1ba2294606 req-2b46979f-8929-465e-95d3-360d84ea50bb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:03.454212 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63573e85-7feb-4b93-9933-8c1ba2294606 req-2b46979f-8929-465e-95d3-360d84ea50bb tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0820553 Nov 11 14:26:03.502040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.530066 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63573e85-7feb-4b93-9933-8c1ba2294606 req-f01a6cbf-53e9-4e3e-9a42-81856113a9e9 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626826 Nov 11 14:26:03.558916 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.580019 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:03.580691 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 316} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:26:03.594780 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f2663ce-b6cd-4aa1-bb6a-ab0b84478f84,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:03.600356 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.600690 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Added segment 7e1e5771-5b6e-4c8d-9cb9-078030d0f59a of type vlan for network e8ede3e1-9308-43ec-aeec-7d48572a8d4b Nov 11 14:26:03.642360 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.742807 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-18ac963b-3b83-468a-9126-009c88080d2e req-b099db58-cdab-4024-9812-d7165cecff45 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0277691 Nov 11 14:26:03.744163 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.745161 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:03.746149 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.793635 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 2, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:03.822726 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] Pushing event updated for resources: {'Network': ['ID=e8ede3e1-9308-43ec-aeec-7d48572a8d4b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:03.826864 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Checking router: fb1030fc-a673-40f8-8acc-5812ce724bec for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:03.827117 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Updating router fb1030fc-a673-40f8-8acc-5812ce724bec port b97f6646-ee4c-4dac-9a61-7b951a205fbf binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:26:03.848167 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:26:03.862399 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34506) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:03.868379 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Request body: {'subnet': {'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-221554170-subnet', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:03.873968 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1db77935-6eeb-4b05-8cd8-a4fbc2ce18a1 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6088171 Nov 11 14:26:03.876718 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:03.915354 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device fd57231c-3882-4ca8-9947-76ba90b2197b up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:03.941742 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Made reservation on behalf of 52b6cc5d3c34431399cfdc162f14356f for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:03.944334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.066204 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port fd57231c-3882-4ca8-9947-76ba90b2197b triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:04.066578 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.187161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.243535 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=107ceeab-6d4d-485b-9235-1cf7f0b88b8e,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:04.255977 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Checking segment: {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:04.256487 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Network hostable DHCP agents. Network: e8ede3e1-9308-43ec-aeec-7d48572a8d4b, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:26:04.289201 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.336683 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:26:04.337912 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6ff132-6d80-448a-ab71-0063f684a85e req-93ce2337-ba96-4b6a-9b95-81ae1f835c97 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:04.339563 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8f6ff132-6d80-448a-ab71-0063f684a85e req-93ce2337-ba96-4b6a-9b95-81ae1f835c97 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 944 time: 0.0493968 Nov 11 14:26:04.364463 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.398489 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8f6ff132-6d80-448a-ab71-0063f684a85e req-1ad3166f-75db-4849-ab7b-743349f72035 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525448 Nov 11 14:26:04.439033 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, e8ede3e1-9308-43ec-aeec-7d48572a8d4b) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:04.440111 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6586fc1e-e203-48c0-90ab-32126b1fc3c3 None None] Pushing event updated for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:04.446421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:04.447014 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.459518 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a1b8118-318c-4ac9-9765-771e60e6b33f None None] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:26:04.486975 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Attempting to bind port b97f6646-ee4c-4dac-9a61-7b951a205fbf on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:04.487337 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Attempting to bind port b97f6646-ee4c-4dac-9a61-7b951a205fbf by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:04.487762 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Attempting to bind port b97f6646-ee4c-4dac-9a61-7b951a205fbf on network 974515c5-e282-45f9-84fa-971ce619e2ed {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:04.597147 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7e9bd64f-796a-441e-9a02-69eeb29246e5 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7334213 Nov 11 14:26:04.599747 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34520) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:04.604289 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:04.652782 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:04.653360 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Checking segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:04.653463 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.653814 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Bound using segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:04.654275 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Bound port: b97f6646-ee4c-4dac-9a61-7b951a205fbf, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:04.654645 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.669762 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970012f6-0b49-4b33-9187-912b79bc9c93 req-4c83041a-8524-40bf-b224-7446393f5d75 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:04.671398 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-970012f6-0b49-4b33-9187-912b79bc9c93 req-4c83041a-8524-40bf-b224-7446393f5d75 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0613050 Nov 11 14:26:04.719776 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-970012f6-0b49-4b33-9187-912b79bc9c93 req-2471f63e-a157-4269-a548-539623b9571b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421309 Nov 11 14:26:04.723201 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-212d1330-4707-4828-8b8b-cd3b96af374a None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:04.723600 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-212d1330-4707-4828-8b8b-cd3b96af374a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.728274 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.728274 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.793551 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.808393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] For port b97f6646-ee4c-4dac-9a61-7b951a205fbf, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:04.823800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-212d1330-4707-4828-8b8b-cd3b96af374a None None] Port b97f6646-ee4c-4dac-9a61-7b951a205fbf cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:04.828613 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9fc233a0-6327-400e-a19a-24c5a90afe25 req-c9d33a22-7ded-4991-a41c-c491ad063686 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0314994 Nov 11 14:26:04.830272 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] For port b97f6646-ee4c-4dac-9a61-7b951a205fbf, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b97f6646-ee4c-4dac-9a61-7b951a205fbf,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:04.864876 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'fixed_ips': [{'subnet_id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:26:04.866278 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:04.934893 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.020364 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.044227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:05.044865 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:05.054851 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6586fc1e-e203-48c0-90ab-32126b1fc3c3 None None] Pushing event updated for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:05.118716 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Allocated IP 172.20.0.2 (e8ede3e1-9308-43ec-aeec-7d48572a8d4b/107ceeab-6d4d-485b-9235-1cf7f0b88b8e/290f782f-aa7a-4e53-95a5-a592520e2d45) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:05.228926 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:05.308899 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.327218 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.330667 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:05.331032 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.444265 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Allocated IP 172.27.1.107 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/324d2670-88f2-47c2-ae08-2130306612f3) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:05.493235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.522486 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f68003-b922-4cc7-a6ab-56be1e2bbda2 req-efde3076-9735-4aa6-af42-5e29fc8ca182 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:05.524696 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-85f68003-b922-4cc7-a6ab-56be1e2bbda2 req-efde3076-9735-4aa6-af42-5e29fc8ca182 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 944 time: 0.0565453 Nov 11 14:26:05.552930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.570609 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.575654 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-85f68003-b922-4cc7-a6ab-56be1e2bbda2 req-2f2a56d9-c608-4478-abce-d45de4b6e71c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434570 Nov 11 14:26:05.584125 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.633727 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.636196 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:05.648251 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:05.652253 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:05.669728 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:05.672599 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:05.674604 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] For port b97f6646-ee4c-4dac-9a61-7b951a205fbf, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b97f6646-ee4c-4dac-9a61-7b951a205fbf,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:05.676399 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:05.679936 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Pushing event updated for resources: {'Port': ['ID=290f782f-aa7a-4e53-95a5-a592520e2d45,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:05.685805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:04Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:05.716334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Pushing event updated for resources: {'Port': ['ID=324d2670-88f2-47c2-ae08-2130306612f3,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:05.730028 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5075ace7-2bd4-48fd-9314-4d223026778d None None] The sync data for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi is: [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:04Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:05.734839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.827158 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Attempting to bind port 290f782f-aa7a-4e53-95a5-a592520e2d45 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:05.827460 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Attempting to bind port 290f782f-aa7a-4e53-95a5-a592520e2d45 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:05.827817 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Attempting to bind port 290f782f-aa7a-4e53-95a5-a592520e2d45 on network e8ede3e1-9308-43ec-aeec-7d48572a8d4b {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:05.846368 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:05.846816 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Checking segment: {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:05.847120 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.847674 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Bound using segment: {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:05.848194 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Bound port: 290f782f-aa7a-4e53-95a5-a592520e2d45, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:05.849896 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:05.894646 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742ea865-09af-4d49-96f2-fdc584df8d10 None None] Pushing event updated for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:05.947575 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7432283-51af-4845-bfaa-83a7b552bda0 req-692d2928-4eb3-46e5-93e0-75cb44707b2b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:05.964072 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7432283-51af-4845-bfaa-83a7b552bda0 req-692d2928-4eb3-46e5-93e0-75cb44707b2b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1113758 Nov 11 14:26:06.015739 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3947fbf5-1e81-4ac2-86e2-e2537f713b36 req-a5a0653f-1021-48ef-9128-4873f84ee99a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0475714 Nov 11 14:26:06.048112 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] For port 290f782f-aa7a-4e53-95a5-a592520e2d45, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:06.052194 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b97f6646-ee4c-4dac-9a61-7b951a205fbf up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:06.062675 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7432283-51af-4845-bfaa-83a7b552bda0 req-397c2424-7014-4fa3-9c18-ebf0fca32c22 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976517 Nov 11 14:26:06.090472 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] For port 290f782f-aa7a-4e53-95a5-a592520e2d45, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=290f782f-aa7a-4e53-95a5-a592520e2d45,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:06.096284 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-17b08ce2-8b95-4f1e-9761-fdff293178c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:06.116256 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:06.117220 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:06.139466 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:06.161738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:06.232436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d217bfd-b366-48c4-96b1-f2b23b407cfd None None] Pushing event updated for resources: {'Port': ['ID=290f782f-aa7a-4e53-95a5-a592520e2d45,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:06.393093 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:06.616622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Router e9d00586-f5bc-4db8-82aa-86105e8cab80 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102267) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:26:06.960060 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55cc083-4103-4b8b-800c-4021ee0a4481 req-19a35bf3-272c-4818-9ea7-3751606cb23f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:06.961604 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d55cc083-4103-4b8b-800c-4021ee0a4481 req-19a35bf3-272c-4818-9ea7-3751606cb23f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 944 time: 0.1002676 Nov 11 14:26:07.095808 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:26:07.110320 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Sync routers for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:26:07.122838 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d55cc083-4103-4b8b-800c-4021ee0a4481 req-df9471d1-e461-4f34-b349-07bac6f39303 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1530876 Nov 11 14:26:07.128610 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:07.129954 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:07.182593 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b759ebca-c9c6-4cb7-83b6-c48dee52b659 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:07.182593 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b759ebca-c9c6-4cb7-83b6-c48dee52b659 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1975746 Nov 11 14:26:07.207896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:07.211018 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-5fe2e75e-4c51-4500-86ba-4b1c8c9663fa admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.6100953 Nov 11 14:26:07.213819 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34550) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:07.231685 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-410131fd-7f40-4a7c-9d17-01fcd0293714 req-6c74a6b4-331c-429d-8e2e-0d982acd0031 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0907423 Nov 11 14:26:07.261638 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b517f8-8c7b-40fd-815f-1028d48d6255 req-26a37e06-f702-42f0-b7cf-75d2e5e886d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:07.263242 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b3b517f8-8c7b-40fd-815f-1028d48d6255 req-26a37e06-f702-42f0-b7cf-75d2e5e886d7 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.1889713 Nov 11 14:26:07.332900 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:07.340545 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b3b517f8-8c7b-40fd-815f-1028d48d6255 req-3470f5c9-8e9e-4d2d-8ab6-bb21e13363e1 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670905 Nov 11 14:26:07.366118 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fc20355f-a825-40f3-b18a-7fa460cdedb6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 380 time: 0.1715300 Nov 11 14:26:07.386478 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9075299e-4b48-4df1-85ed-60e26de7dd97 None None] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:26:07.424420 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11372da0-9c60-448f-abda-b3d09c9e351c req-342eb0ea-0a72-4857-ab59-3f43efd5c22d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:07.426038 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-11372da0-9c60-448f-abda-b3d09c9e351c req-342eb0ea-0a72-4857-ab59-3f43efd5c22d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1560247 Nov 11 14:26:07.496233 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] Provisioning complete for port 290f782f-aa7a-4e53-95a5-a592520e2d45 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:07.496898 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:07.531607 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 3, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:07.559831 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'port': {'device_id': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'admin_state_up': True, 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'security_groups': ['2cfa354d-b685-49ff-add6-9fea82052f27']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:07.563692 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Checking router: e9d00586-f5bc-4db8-82aa-86105e8cab80 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:07.564234 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Updating router e9d00586-f5bc-4db8-82aa-86105e8cab80 port 324d2670-88f2-47c2-ae08-2130306612f3 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:26:07.567898 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-11372da0-9c60-448f-abda-b3d09c9e351c req-2176fd41-3533-42cd-8d2c-fd02f6683096 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307285 Nov 11 14:26:07.603577 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:07.873714 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:07.915895 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] For port 290f782f-aa7a-4e53-95a5-a592520e2d45, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=290f782f-aa7a-4e53-95a5-a592520e2d45,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:07.919972 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Made reservation on behalf of 2d09ad6536ff49c4b4e43c8239742bc5 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:07.933808 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:07.969122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:07.973689 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.000670 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.044747 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 290f782f-aa7a-4e53-95a5-a592520e2d45 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:08.086711 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.138115 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548c3eb1-cabd-460f-b3d0-95dc2511b056 None None] Pushing event updated for resources: {'Port': ['ID=290f782f-aa7a-4e53-95a5-a592520e2d45,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:08.138705 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.146586 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-0dbeb664-42e8-4c8c-9f89-9da1f4ad19ef None None] Provisioning complete for port 290f782f-aa7a-4e53-95a5-a592520e2d45 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:08.147523 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0dbeb664-42e8-4c8c-9f89-9da1f4ad19ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.149916 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Attempting to bind port 324d2670-88f2-47c2-ae08-2130306612f3 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:08.152759 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Attempting to bind port 324d2670-88f2-47c2-ae08-2130306612f3 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:08.153616 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Attempting to bind port 324d2670-88f2-47c2-ae08-2130306612f3 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:08.162032 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:08.164890 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:08.164890 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.165339 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:08.166084 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Bound port: 324d2670-88f2-47c2-ae08-2130306612f3, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:08.166690 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.180636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.20.0.14 (4bad907f-fd8e-4849-9ded-63b7501aff2a/2b677022-3ca7-40d0-ba96-f88e6df9c517/a304cf63-faf2-4bfa-964d-9112da652ad0) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:08.185803 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 290f782f-aa7a-4e53-95a5-a592520e2d45 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:08.186172 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.212472 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Pushing event updated for resources: {'Port': ['ID=324d2670-88f2-47c2-ae08-2130306612f3,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:08.222729 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.223482 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.224022 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.224552 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.225166 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.226026 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.226577 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.227126 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.227691 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.228181 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.229776 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.229776 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:08.230159 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:26:08.242370 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:08.242711 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.269023 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] For port 324d2670-88f2-47c2-ae08-2130306612f3, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:08.273324 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] For port 324d2670-88f2-47c2-ae08-2130306612f3, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=324d2670-88f2-47c2-ae08-2130306612f3,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:08.337823 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.345395 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b97f6646-ee4c-4dac-9a61-7b951a205fbf up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:08.363860 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-99aca5e6-d5b5-4e7a-a761-052e22b46395 req-f898f8d9-fc98-4bf4-8eb0-315deca0ee21 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0410936 Nov 11 14:26:08.417882 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:08.418248 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:25:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:08.426456 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74fabe01-8196-4859-969b-8df061b1a62f req-1d0d7f61-56d3-4cfd-85b4-e131c24a3340 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:08.429615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.434483 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-74fabe01-8196-4859-969b-8df061b1a62f req-1d0d7f61-56d3-4cfd-85b4-e131c24a3340 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 944 time: 0.1795433 Nov 11 14:26:08.460371 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:08.462728 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07842ee6-a823-4bd5-a8be-4e337bf2cf43" -d '{"events": [{"server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "name": "network-vif-plugged", "status": "completed", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:08.474101 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b97f6646-ee4c-4dac-9a61-7b951a205fbf triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:08.474101 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.479984 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:08.502838 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.522394 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68c793b6-4389-45c2-bcc0-4ab29b2ba575 x-openstack-request-id: req-68c793b6-4389-45c2-bcc0-4ab29b2ba575 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:08.522690 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "name": "network-vif-plugged", "status": "completed", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:08.523470 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-68c793b6-4389-45c2-bcc0-4ab29b2ba575 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:08.527166 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0', 'code': 200} Nov 11 14:26:08.527166 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-019e8f65-dc4d-4ac8-a69b-82518f2567e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.564248 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ba6b66-6030-4d83-83ff-22a6635eb6fe None None] Pushing event updated for resources: {'Port': ['ID=324d2670-88f2-47c2-ae08-2130306612f3,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:08.568035 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-74fabe01-8196-4859-969b-8df061b1a62f req-cedf3468-b58c-4e96-bad2-461699b17e57 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326203 Nov 11 14:26:08.594484 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Allocated IP 172.20.0.1 (e8ede3e1-9308-43ec-aeec-7d48572a8d4b/107ceeab-6d4d-485b-9235-1cf7f0b88b8e/27637972-914c-4969-bca4-2afdaec3b261) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:08.606904 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.658180 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:08.706090 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:08.755679 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.805705 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1fe965a-c23a-4189-b749-be116c5ed8b2 req-f9baebfa-18c6-4f01-8f9b-c186733a5f9c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:08.820094 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d1fe965a-c23a-4189-b749-be116c5ed8b2 req-f9baebfa-18c6-4f01-8f9b-c186733a5f9c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1212289 Nov 11 14:26:08.847965 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:08.855690 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:08.870043 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:08.892083 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:08.892083 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:08.925983 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d1fe965a-c23a-4189-b749-be116c5ed8b2 req-66eba1da-8ba2-4919-8af3-11047aadcd0c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045775 Nov 11 14:26:08.998821 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:08.999456 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.034886 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 3, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:09.038873 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe84b7cc-493e-4b84-883f-c20bb8798b21 req-7e688ef3-4b90-4311-b4e6-104f5dcd339f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:09.040731 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe84b7cc-493e-4b84-883f-c20bb8798b21 req-7e688ef3-4b90-4311-b4e6-104f5dcd339f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 1098 time: 0.0500419 Nov 11 14:26:09.068497 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84a0e18-79d7-4c4e-af4a-7989dd39f0d2 None None] The sync data for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi is: [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 3, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:09.101869 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe84b7cc-493e-4b84-883f-c20bb8798b21 req-14cedacb-9251-44a2-8cdd-a2391f9dbc4f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534172 Nov 11 14:26:09.138830 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-db82e95d-84a9-401a-8190-86675edf3ea9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5843606 Nov 11 14:26:09.140103 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.164355 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-f570923f-190c-4a33-aefe-271f93bd8046 None None] Provisioning complete for port a304cf63-faf2-4bfa-964d-9112da652ad0 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:09.164714 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-f570923f-190c-4a33-aefe-271f93bd8046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.184510 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:09.189575 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:09.193207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:09.200050 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Pushing event updated for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:09.204303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-f570923f-190c-4a33-aefe-271f93bd8046 None None] Port a304cf63-faf2-4bfa-964d-9112da652ad0 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:09.244612 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.326726 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Request body: {'port': {'device_id': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:09.438158 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.613743 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5761393c-90f1-436d-94b0-878405bba6bc req-60593791-329d-42b0-906c-38461dd49f31 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:09.617048 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5761393c-90f1-436d-94b0-878405bba6bc req-60593791-329d-42b0-906c-38461dd49f31 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 932 time: 0.1060107 Nov 11 14:26:09.636412 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-42c35fcc-d5ad-40fa-a416-c63102cd0f02 None None] Provisioning complete for port 27637972-914c-4969-bca4-2afdaec3b261 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:09.637623 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-42c35fcc-d5ad-40fa-a416-c63102cd0f02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.692609 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.698337 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5761393c-90f1-436d-94b0-878405bba6bc req-bbd583e6-5b52-4c27-98ed-f87200a4eebb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710168 Nov 11 14:26:09.701181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-42c35fcc-d5ad-40fa-a416-c63102cd0f02 None None] Port 27637972-914c-4969-bca4-2afdaec3b261 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:09.800027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:09.843793 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb6fe82-57ce-4a2a-8308-a91889f5681d req-0b3208f7-3df9-4f41-ae58-e2a0d542ef1c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:09.845375 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fb6fe82-57ce-4a2a-8308-a91889f5681d req-0b3208f7-3df9-4f41-ae58-e2a0d542ef1c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.1678541 Nov 11 14:26:09.968713 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 290f782f-aa7a-4e53-95a5-a592520e2d45 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:10.036153 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 290f782f-aa7a-4e53-95a5-a592520e2d45 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:10.036724 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.108696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524d7f71-2294-4122-9770-8238056b95cb req-b6c6b84e-c6a6-4f1a-a32b-2c5a7b088bc8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:10.112859 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-524d7f71-2294-4122-9770-8238056b95cb req-b6c6b84e-c6a6-4f1a-a32b-2c5a7b088bc8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1054184 Nov 11 14:26:10.151970 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 324d2670-88f2-47c2-ae08-2130306612f3 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:10.203648 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-524d7f71-2294-4122-9770-8238056b95cb req-97be4696-005d-4e97-af1f-c24e598ea6ae tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706298 Nov 11 14:26:10.214234 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 324d2670-88f2-47c2-ae08-2130306612f3 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:10.214603 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.265970 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fb6fe82-57ce-4a2a-8308-a91889f5681d req-56ce0a06-68df-483f-b119-aa6188f40e07 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3976579 Nov 11 14:26:10.326903 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.329358 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a304cf63-faf2-4bfa-964d-9112da652ad0 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:26:10.345072 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.359100 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 324d2670-88f2-47c2-ae08-2130306612f3, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=324d2670-88f2-47c2-ae08-2130306612f3,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:10.369954 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Transition to ACTIVE for port object a304cf63-faf2-4bfa-964d-9112da652ad0 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:26:10.402055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.427218 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.477114 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=324d2670-88f2-47c2-ae08-2130306612f3,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:10.507872 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.545070 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.596076 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Pushing event updated for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:10.676309 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.738345 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Pushing event updated for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:10.794974 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.802723 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Attempting to bind port a304cf63-faf2-4bfa-964d-9112da652ad0 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:10.808186 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Attempting to bind port a304cf63-faf2-4bfa-964d-9112da652ad0 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:10.808186 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Attempting to bind port a304cf63-faf2-4bfa-964d-9112da652ad0 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:10.854417 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Port a304cf63-faf2-4bfa-964d-9112da652ad0 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:26:10.854417 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Attempting to bind port a304cf63-faf2-4bfa-964d-9112da652ad0 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:10.885219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 25, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:10.885559 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:10.894080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Bound using segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:10.894080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Bound port: a304cf63-faf2-4bfa-964d-9112da652ad0, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:10.894352 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7a8934-5ae8-4227-aa9a-6ef79ca955e9 req-5808f2ef-70b7-4d3c-bb75-f58e03bb6de7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:10.894786 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:10.894880 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5b7a8934-5ae8-4227-aa9a-6ef79ca955e9 req-5808f2ef-70b7-4d3c-bb75-f58e03bb6de7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0775714 Nov 11 14:26:10.919821 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:10.924006 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:10.976930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ceb19e-f921-4464-a8ed-1d3df73e4634 req-34ce55c0-8e83-4345-a53d-3722b900ff92 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:10.978522 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f6ceb19e-f921-4464-a8ed-1d3df73e4634 req-34ce55c0-8e83-4345-a53d-3722b900ff92 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1681063 Nov 11 14:26:11.025623 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5b7a8934-5ae8-4227-aa9a-6ef79ca955e9 req-13417dbb-96ae-470a-ba07-59228c35ed85 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1189725 Nov 11 14:26:11.037884 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-90204614-2a8d-471e-8c74-204ffaa13dc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.040819 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-90204614-2a8d-471e-8c74-204ffaa13dc2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 1099 time: 0.1110115 Nov 11 14:26:11.093362 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:11.115261 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a304cf63-faf2-4bfa-964d-9112da652ad0,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:11.182610 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f6ceb19e-f921-4464-a8ed-1d3df73e4634 req-08e08c9c-5673-4a2a-9f81-6fe3fa12ccf1 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1924424 Nov 11 14:26:11.188592 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-59d26384-f015-424f-9acf-978cb680f382 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.190069 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-59d26384-f015-424f-9acf-978cb680f382 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 200 len: 920 time: 0.1401100 Nov 11 14:26:11.205001 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:11.213497 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Router e9d00586-f5bc-4db8-82aa-86105e8cab80 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:26:11.239915 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-16d43046-1da6-402b-810a-14c1659581f0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 200 len: 217 time: 0.0418131 Nov 11 14:26:11.258830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.259453 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:11.260801 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] 10.222.0.11 "PUT /v2.0/ports/a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 200 len: 1094 time: 1.9490323 Nov 11 14:26:11.262940 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:11.265601 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d225413e-5fc4-4090-94b1-896a40cd369e" -d '{"events": [{"name": "network-changed", "server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:11.300120 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa893be5-2e8b-4abd-ba9d-f19771417e9d service neutron] Pushing event updated for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:11.314766 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-bb699ae0-ae18-46fa-ac6c-a6c89ab7034f None None] Provisioning complete for port 27637972-914c-4969-bca4-2afdaec3b261 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:11.314766 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-bb699ae0-ae18-46fa-ac6c-a6c89ab7034f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:11.378761 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-850ace2f-7d07-49ee-ab49-1fa7042acdc0 x-openstack-request-id: req-850ace2f-7d07-49ee-ab49-1fa7042acdc0 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:11.379030 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:11.379277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-850ace2f-7d07-49ee-ab49-1fa7042acdc0 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:11.379689 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'status': 'completed', 'code': 200} Nov 11 14:26:11.383406 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-02d8c8de-ca63-451b-8e20-c5f66ec62aad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.388445 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-02d8c8de-ca63-451b-8e20-c5f66ec62aad service neutron] 10.222.0.11 "GET /v2.0/subnets?id=9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 200 len: 859 time: 0.1396739 Nov 11 14:26:11.414334 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-bb699ae0-ae18-46fa-ac6c-a6c89ab7034f None None] Port 27637972-914c-4969-bca4-2afdaec3b261 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:11.445336 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-8dff8377-18f1-4e73-825b-1269ac025163 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bc415290-2d4a-450f-b1bb-bf8153b56614&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0448380 Nov 11 14:26:11.532610 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b0c91f9b-f4ff-47aa-90ca-1ce64672a3ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.534848 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-b0c91f9b-f4ff-47aa-90ca-1ce64672a3ed service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1097 time: 0.1542103 Nov 11 14:26:11.574307 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-639dd08e-5a5a-4915-8a42-0a840cdbff9d service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1209459 Nov 11 14:26:11.593471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69bbedac-98ab-4a41-98f5-6c8fbf17c060 req-9f47990d-a36b-4e03-a72e-e316571305c2 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.594918 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-69bbedac-98ab-4a41-98f5-6c8fbf17c060 req-9f47990d-a36b-4e03-a72e-e316571305c2 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.1603084 Nov 11 14:26:11.596400 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:26:11.598674 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-6c93fae6-7a60-475f-b1df-ba2d53b4e346 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 200 len: 217 time: 0.0514293 Nov 11 14:26:11.604169 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-556e0e79-5cbe-4afd-9cbc-1221a5cf9c2d admin admin] 10.222.0.10 "PUT /v2.0/routers/e9d00586-f5bc-4db8-82aa-86105e8cab80/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3879750 Nov 11 14:26:11.701365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:11.731594 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-69bbedac-98ab-4a41-98f5-6c8fbf17c060 req-c6abc529-0f99-4150-96b4-6be01fe3eab4 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201234 Nov 11 14:26:11.731594 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-eae5fd2e-6caa-499c-b2e3-230b670d1337 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.731594 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-eae5fd2e-6caa-499c-b2e3-230b670d1337 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0931749 Nov 11 14:26:11.752197 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2aea17ae-bf62-4268-b15d-cc189fafe0c8 req-52f8c934-9425-4765-978a-59489cc5101f service neutron] 10.222.0.11 "GET /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1678536 Nov 11 14:26:11.788028 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-100350ce-5124-4fdf-9cca-f90578554197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:11.789539 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-100350ce-5124-4fdf-9cca-f90578554197 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0497143 Nov 11 14:26:11.936731 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 324d2670-88f2-47c2-ae08-2130306612f3 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:11.976968 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-d8bd34f3-8f2e-4cce-90fb-1b4ebda36f43 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1697767 Nov 11 14:26:12.047180 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 324d2670-88f2-47c2-ae08-2130306612f3 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:12.047714 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:12.083402 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e2ecf5-284f-4170-8ed6-e52071b8ba2e req-34f4089f-8294-48c1-9e5a-5a21106a22d7 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0976171 Nov 11 14:26:12.101667 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:12.196717 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4636efa8-a333-4b9d-96d7-06023def53d5 req-df6d7d39-16c2-4837-9307-22fa139575da tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.197647 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4636efa8-a333-4b9d-96d7-06023def53d5 req-df6d7d39-16c2-4837-9307-22fa139575da tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0700057 Nov 11 14:26:12.265606 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Sync routers for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:26:12.282527 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4636efa8-a333-4b9d-96d7-06023def53d5 req-a1626cc7-3769-42b9-b7ee-123ba8688f6b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785620 Nov 11 14:26:12.294690 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:12.295603 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:12.333677 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d225413e-5fc4-4090-94b1-896a40cd369e req-6ebec122-83e0-4a1d-b6c2-8aae5ec44d12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.335783 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-6ebec122-83e0-4a1d-b6c2-8aae5ec44d12 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1097 time: 0.0852635 Nov 11 14:26:12.414462 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:12.444500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502fe3de-634a-4625-8b6a-46dc55f3d14e req-aac9c48b-5ed6-45b5-a15b-40e5eac74490 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.446068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-502fe3de-634a-4625-8b6a-46dc55f3d14e req-aac9c48b-5ed6-45b5-a15b-40e5eac74490 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.1093986 Nov 11 14:26:12.496676 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d225413e-5fc4-4090-94b1-896a40cd369e req-a390da20-3621-47d0-9d09-98f066c9fba3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.498289 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-a390da20-3621-47d0-9d09-98f066c9fba3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.1266630 Nov 11 14:26:12.519848 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-502fe3de-634a-4625-8b6a-46dc55f3d14e req-eaccc2c1-3e27-4af1-9a43-f48482b199d0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657089 Nov 11 14:26:12.549786 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-3f5691a3-7313-447d-b0b9-1e9d794bf31f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 200 len: 217 time: 0.0411594 Nov 11 14:26:12.615217 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d225413e-5fc4-4090-94b1-896a40cd369e req-350fb48f-7f4a-4762-9862-2af8f68ead8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.616826 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-350fb48f-7f4a-4762-9862-2af8f68ead8d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0584319 Nov 11 14:26:12.669031 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:09Z', 'revision_number': 4, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '27637972-914c-4969-bca4-2afdaec3b261', 'name': '', 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'mac_address': 'fa:16:3e:53:4b:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:08Z', 'updated_at': '2021-11-11T14:26:10Z', 'revision_number': 2, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'subnets': [{'id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:12.677386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d225413e-5fc4-4090-94b1-896a40cd369e req-a835c46a-d63e-449f-a415-e9ff5b8e6716 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:12.679064 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-a835c46a-d63e-449f-a415-e9ff5b8e6716 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0543914 Nov 11 14:26:12.703037 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Checking router: e9d00586-f5bc-4db8-82aa-86105e8cab80 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:12.703735 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Updating router e9d00586-f5bc-4db8-82aa-86105e8cab80 port 27637972-914c-4969-bca4-2afdaec3b261 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:26:12.733511 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:12.817779 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-041aec53-0e7b-4b22-a748-809b8d2c0825 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1309259 Nov 11 14:26:12.960503 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d225413e-5fc4-4090-94b1-896a40cd369e req-46a9d132-54d1-4988-9aa0-60ea18e599f4 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1332114 Nov 11 14:26:13.069448 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.181820 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.261447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae358197-bf04-4754-9c09-2d22db8fcf38 None None] Pushing event updated for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:13.309950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Attempting to bind port 27637972-914c-4969-bca4-2afdaec3b261 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:13.310361 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Attempting to bind port 27637972-914c-4969-bca4-2afdaec3b261 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:13.310769 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Attempting to bind port 27637972-914c-4969-bca4-2afdaec3b261 on network e8ede3e1-9308-43ec-aeec-7d48572a8d4b {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:13.318680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 26, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:13.319669 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Checking segment: {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:13.320008 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.320396 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Bound using segment: {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:13.320875 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Bound port: 27637972-914c-4969-bca4-2afdaec3b261, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 316, 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:13.321427 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.472733 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec43aebd-6dc5-4e5d-8c91-b3fac73f346d req-e73f12b4-c34f-4fd0-bbfc-6722ac7b77fd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:13.482073 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ec43aebd-6dc5-4e5d-8c91-b3fac73f346d req-e73f12b4-c34f-4fd0-bbfc-6722ac7b77fd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.1019626 Nov 11 14:26:13.482901 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] For port 27637972-914c-4969-bca4-2afdaec3b261, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:13.488950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] For port 27637972-914c-4969-bca4-2afdaec3b261, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=27637972-914c-4969-bca4-2afdaec3b261,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:13.557279 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ec43aebd-6dc5-4e5d-8c91-b3fac73f346d req-24fbbf32-3270-473a-a968-802826f6f0cd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680699 Nov 11 14:26:13.589824 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.635049 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] Provisioning complete for port 27637972-914c-4969-bca4-2afdaec3b261 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:13.635786 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:13.666590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314f814-8a45-42ee-8ea8-d38bb2913a7c req-28521e95-1333-4fda-8afd-ac32e16d04db tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:13.668976 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2314f814-8a45-42ee-8ea8-d38bb2913a7c req-28521e95-1333-4fda-8afd-ac32e16d04db tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0573623 Nov 11 14:26:13.741507 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2314f814-8a45-42ee-8ea8-d38bb2913a7c req-fad6d4dd-683f-4e69-81ff-686d748fcc86 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591302 Nov 11 14:26:14.011752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae358197-bf04-4754-9c09-2d22db8fcf38 None None] Pushing event updated for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:14.011752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:14.011752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:14.011752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:14.120380 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] For port 27637972-914c-4969-bca4-2afdaec3b261, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=27637972-914c-4969-bca4-2afdaec3b261,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:14.138382 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:14.376437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:09Z', 'revision_number': 4, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '27637972-914c-4969-bca4-2afdaec3b261', 'name': '', 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'mac_address': 'fa:16:3e:53:4b:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:08Z', 'updated_at': '2021-11-11T14:26:13Z', 'revision_number': 4, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'subnets': [{'id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:14.409676 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30bfae6f-5161-402c-a376-97ab882c2e8e None None] The sync data for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi is: [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:26:09Z', 'revision_number': 4, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '27637972-914c-4969-bca4-2afdaec3b261', 'name': '', 'network_id': 'e8ede3e1-9308-43ec-aeec-7d48572a8d4b', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'mac_address': 'fa:16:3e:53:4b:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:08Z', 'updated_at': '2021-11-11T14:26:13Z', 'revision_number': 4, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'subnets': [{'id': '107ceeab-6d4d-485b-9235-1cf7f0b88b8e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:14.455771 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:14.556837 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2c027db-bd2c-444c-9280-44861d5dd803 None None] Pushing event updated for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:14.588838 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-72404a20-c992-414a-b54f-74b1c94d5523 None None] Provisioning complete for port 27637972-914c-4969-bca4-2afdaec3b261 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:14.589849 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-72404a20-c992-414a-b54f-74b1c94d5523 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:14.709515 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68631a7d-af5f-4cf3-9a47-e742e5279603 req-4fec4c79-9e31-4a6f-9559-3d2cd6958d64 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:14.716845 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-68631a7d-af5f-4cf3-9a47-e742e5279603 req-4fec4c79-9e31-4a6f-9559-3d2cd6958d64 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0721517 Nov 11 14:26:14.773348 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-68631a7d-af5f-4cf3-9a47-e742e5279603 req-5bbc0849-3949-40e9-a32b-127a60fb0bfe tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508049 Nov 11 14:26:14.911108 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52fc8f7-a793-4728-8ba0-25674baccfd1 req-33b16149-c5de-4119-b33b-9481f1691dca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:14.913199 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e52fc8f7-a793-4728-8ba0-25674baccfd1 req-33b16149-c5de-4119-b33b-9481f1691dca tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0579772 Nov 11 14:26:14.984545 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e52fc8f7-a793-4728-8ba0-25674baccfd1 req-e1d09ca4-1893-471f-bc60-ddd64b6cd19e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619018 Nov 11 14:26:15.930545 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fab8947-3227-41d6-abfd-ae5680c71ea7 req-92d6659f-139c-455b-a451-e631fe5a970b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:15.933080 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fab8947-3227-41d6-abfd-ae5680c71ea7 req-92d6659f-139c-455b-a451-e631fe5a970b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0716193 Nov 11 14:26:15.958146 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 27637972-914c-4969-bca4-2afdaec3b261 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:16.015346 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fab8947-3227-41d6-abfd-ae5680c71ea7 req-0227e63c-c711-4216-bced-ce7ec99cd25c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0751278 Nov 11 14:26:16.053750 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 27637972-914c-4969-bca4-2afdaec3b261 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:16.055857 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:16.148635 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a98885-ec23-48c5-bc88-dc2b7b834267 req-0666fdc6-2fc3-40cb-b561-9947b9d1d735 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:16.157386 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-96a98885-ec23-48c5-bc88-dc2b7b834267 req-0666fdc6-2fc3-40cb-b561-9947b9d1d735 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0766056 Nov 11 14:26:16.212453 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-96a98885-ec23-48c5-bc88-dc2b7b834267 req-33e8072e-d469-45b8-acd5-6d2e77ee0210 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537724 Nov 11 14:26:17.161209 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d01cb74-8e7a-4797-beee-acadcea37926 req-185b2e61-5b80-4ca5-96da-a6f834388f9f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:17.163313 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9d01cb74-8e7a-4797-beee-acadcea37926 req-185b2e61-5b80-4ca5-96da-a6f834388f9f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0666831 Nov 11 14:26:17.239204 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9d01cb74-8e7a-4797-beee-acadcea37926 req-7f46fd30-30c9-44ed-a70c-93190cc0513d tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692966 Nov 11 14:26:17.371602 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5956152d-0a62-4ad8-a76e-c216187687e8 req-81060af2-4080-4283-b841-94112757358d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:17.375841 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5956152d-0a62-4ad8-a76e-c216187687e8 req-81060af2-4080-4283-b841-94112757358d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0557179 Nov 11 14:26:17.435987 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5956152d-0a62-4ad8-a76e-c216187687e8 req-0cdd8d24-6b10-471c-a187-a4190c4767af tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557790 Nov 11 14:26:18.395220 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873d7bc6-a9f9-412b-bcf4-faef568d3a47 req-61afe64f-018f-4581-a978-2dabc6f7fce2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:18.398254 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-873d7bc6-a9f9-412b-bcf4-faef568d3a47 req-61afe64f-018f-4581-a978-2dabc6f7fce2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0573194 Nov 11 14:26:18.463171 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-873d7bc6-a9f9-412b-bcf4-faef568d3a47 req-0bc05d77-cb08-449d-aef8-553b50b0625a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568333 Nov 11 14:26:19.593625 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920ee410-4a1b-4ec9-a2cd-187e62211d72 req-d13d40d6-ec45-48e7-82a6-a2ab2afa38a8 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:19.595105 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-920ee410-4a1b-4ec9-a2cd-187e62211d72 req-d13d40d6-ec45-48e7-82a6-a2ab2afa38a8 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 944 time: 0.0543063 Nov 11 14:26:19.651396 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-920ee410-4a1b-4ec9-a2cd-187e62211d72 req-eb113570-8607-424d-9438-a0247377b740 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497293 Nov 11 14:26:20.027843 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a304cf63-faf2-4bfa-964d-9112da652ad0 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:26:20.160039 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a304cf63-faf2-4bfa-964d-9112da652ad0,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:20.173122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'port_id': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'mac_address': 'fa:16:3e:d1:27:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:26:20.220567 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:20.248498 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a304cf63-faf2-4bfa-964d-9112da652ad0 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:26:20.273801 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a304cf63-faf2-4bfa-964d-9112da652ad0,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:20.369850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:20.474886 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:20.697852 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['a304cf63-faf2-4bfa-964d-9112da652ad0'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:26:20.843104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1caac3aa-6a8f-4d86-a512-80301455c034 req-e294c9d4-863a-49c9-b219-8aa8ce742c84 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:20.845283 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1caac3aa-6a8f-4d86-a512-80301455c034 req-e294c9d4-863a-49c9-b219-8aa8ce742c84 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 945 time: 0.0962427 Nov 11 14:26:20.916432 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1caac3aa-6a8f-4d86-a512-80301455c034 req-2607b319-5950-4064-83dd-8b9c8d43848e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632758 Nov 11 14:26:21.700704 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34866) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:21.903722 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f85aac44-ad55-471b-a3a1-75adc3ee4c91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.055303 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f85aac44-ad55-471b-a3a1-75adc3ee4c91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.074362 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a304cf63-faf2-4bfa-964d-9112da652ad0 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:22.100651 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebea0a36-d607-4aa4-bf91-122d4f6ee6ab req-a787f7c1-6a1d-4e39-bd0a-8471cac850cb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:22.102168 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebea0a36-d607-4aa4-bf91-122d4f6ee6ab req-a787f7c1-6a1d-4e39-bd0a-8471cac850cb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 945 time: 0.0756135 Nov 11 14:26:22.132008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f85aac44-ad55-471b-a3a1-75adc3ee4c91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.194767 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-f85aac44-ad55-471b-a3a1-75adc3ee4c91 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=cf5f9aa5eb9f47beaa9dde30429f43a8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4904854 Nov 11 14:26:22.195276 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34884) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:22.204420 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85aac44-ad55-471b-a3a1-75adc3ee4c91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f183a5b-3ac2-4941-ac5a-c798359f6edc,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:22.215355 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port a304cf63-faf2-4bfa-964d-9112da652ad0 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:26:22.220857 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port a304cf63-faf2-4bfa-964d-9112da652ad0 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:22.221282 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.226621 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ebea0a36-d607-4aa4-bf91-122d4f6ee6ab req-68c0834c-7c0e-4d21-990e-1443749d8550 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1110759 Nov 11 14:26:22.275492 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.299046 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.314825 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.339027 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:22.341779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8be651d-b190-4aee-85e8-b47bad590791" -d '{"events": [{"server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "name": "network-vif-plugged", "status": "completed", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:22.358179 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a304cf63-faf2-4bfa-964d-9112da652ad0,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:22.393777 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b04bf68-c8b7-49d3-a614-1bbc8c188ff8 x-openstack-request-id: req-4b04bf68-c8b7-49d3-a614-1bbc8c188ff8 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:22.393777 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "name": "network-vif-plugged", "status": "completed", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:22.393777 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4b04bf68-c8b7-49d3-a614-1bbc8c188ff8 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:22.393777 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'code': 200} Nov 11 14:26:22.449656 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.450033 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.453514 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:22.455411 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4f183a5b-3ac2-4941-ac5a-c798359f6edc HTTP/1.1" status: 204 len: 168 time: 0.2580552 Nov 11 14:26:22.469503 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15be5985-ddcd-4e8d-9ccc-2edfe9e8b795 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f183a5b-3ac2-4941-ac5a-c798359f6edc,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:22.588459 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:22.860431 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155444be-b529-4797-ab21-e02a854e3c9f req-e1e68b3e-a754-4230-8aee-ee59419c728c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:22.863225 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-155444be-b529-4797-ab21-e02a854e3c9f req-e1e68b3e-a754-4230-8aee-ee59419c728c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1099 time: 0.0779126 Nov 11 14:26:22.928245 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-155444be-b529-4797-ab21-e02a854e3c9f req-a6962529-2458-4080-ab9b-ac38b31ed264 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491314 Nov 11 14:26:23.352783 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c770cee-565a-4f37-b285-25c34c32263c req-d47add84-40ff-4923-860b-ce8f58190fc6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:23.354295 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c770cee-565a-4f37-b285-25c34c32263c req-d47add84-40ff-4923-860b-ce8f58190fc6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0537221 Nov 11 14:26:23.410831 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c770cee-565a-4f37-b285-25c34c32263c req-381e4139-b332-44c4-80a9-4e660d303778 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503449 Nov 11 14:26:23.444853 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34908) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:23.458651 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1d909563-f34e-43a3-926d-8e7d7bf05d8c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:23.558816 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1d909563-f34e-43a3-926d-8e7d7bf05d8c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:23.798153 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1d909563-f34e-43a3-926d-8e7d7bf05d8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:23.838397 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1d909563-f34e-43a3-926d-8e7d7bf05d8c admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=340f25cc9c184a72ade0575c16186b23&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3923862 Nov 11 14:26:23.839321 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d909563-f34e-43a3-926d-8e7d7bf05d8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66208764-c9e8-4326-b544-de017f4ae740,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:23.841072 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34914) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:23.915869 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:23.938848 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.056549 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.072049 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.076905 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/66208764-c9e8-4326-b544-de017f4ae740 HTTP/1.1" status: 204 len: 168 time: 0.2347031 Nov 11 14:26:24.093674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34926) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:24.117451 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1646165-4044-40a6-b80c-e7b1edda75e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66208764-c9e8-4326-b544-de017f4ae740,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:24.149142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d23bea-1305-48a4-8d32-44ceda4c07b5 req-d3013c0d-0356-44fa-99ef-0174d9c28421 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:24.160157 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d8d23bea-1305-48a4-8d32-44ceda4c07b5 req-d3013c0d-0356-44fa-99ef-0174d9c28421 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.1156893 Nov 11 14:26:24.219166 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d8d23bea-1305-48a4-8d32-44ceda4c07b5 req-9964472c-3a3c-4875-8418-52a9ff4314d3 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578582 Nov 11 14:26:24.233163 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-91e862a7-a5a4-4ebd-8d32-910c3b39ec3d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.341515 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-91e862a7-a5a4-4ebd-8d32-910c3b39ec3d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.483194 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-91e862a7-a5a4-4ebd-8d32-910c3b39ec3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.555854 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-91e862a7-a5a4-4ebd-8d32-910c3b39ec3d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=fce8154abb854e048a0d294ba81ac489&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4606421 Nov 11 14:26:24.556633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e862a7-a5a4-4ebd-8d32-910c3b39ec3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6952667f-6250-41fc-867b-53cc62461521,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:24.559328 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 34932) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:24.588498 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3117d16b-c173-4c19-96df-f41c04c7e4a2 req-359fab28-83eb-4e6b-ac3f-5e86252bd8ee tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:24.589991 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3117d16b-c173-4c19-96df-f41c04c7e4a2 req-359fab28-83eb-4e6b-ac3f-5e86252bd8ee tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0845180 Nov 11 14:26:24.627329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.641517 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3117d16b-c173-4c19-96df-f41c04c7e4a2 req-f0e30a87-000f-4dcb-b433-f8ff42988bc5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453162 Nov 11 14:26:24.655279 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.769727 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.772952 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:24.779681 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/6952667f-6250-41fc-867b-53cc62461521 HTTP/1.1" status: 204 len: 168 time: 0.2132542 Nov 11 14:26:24.783189 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4afcb1-0382-451f-b064-dc106f00a45e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6952667f-6250-41fc-867b-53cc62461521,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:25.336792 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba59e738-1de6-4c6e-86ec-b3d5c37a6151 req-ea1476c4-73e2-44f8-9954-632d20962cf4 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:25.338280 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ba59e738-1de6-4c6e-86ec-b3d5c37a6151 req-ea1476c4-73e2-44f8-9954-632d20962cf4 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0514774 Nov 11 14:26:25.386612 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ba59e738-1de6-4c6e-86ec-b3d5c37a6151 req-35d4f457-2786-46dc-9fdb-c94c5228114c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425050 Nov 11 14:26:25.760623 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a0e0162-41a6-4033-9577-a4d3ba02462a req-7b1af39b-3a08-49b6-8a04-e4db3f25699b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:25.761497 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4a0e0162-41a6-4033-9577-a4d3ba02462a req-7b1af39b-3a08-49b6-8a04-e4db3f25699b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0504215 Nov 11 14:26:25.773855 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-157fa7e4-341a-4e84-82ae-15a621bb19a2 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:25.775330 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-157fa7e4-341a-4e84-82ae-15a621bb19a2 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 814 time: 0.1107039 Nov 11 14:26:25.794726 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-5fab3781-ae6e-480d-a240-231393ec9d67 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/quotas/43dc465eb95943ee921d1e983a7e0320 HTTP/1.1" status: 200 len: 375 time: 0.0135131 Nov 11 14:26:25.818340 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4a0e0162-41a6-4033-9577-a4d3ba02462a req-d14e9efe-377a-4dc3-84c9-495d0664eb16 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497558 Nov 11 14:26:25.846841 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-c5156f18-e474-424b-844a-856a01d94375 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0464301 Nov 11 14:26:25.943273 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77b91d7-da20-4c66-ac52-91c0082f6473 req-eb1c1cd9-6b27-4e6c-a7c9-be84fe4cdc40 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:25.944826 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d77b91d7-da20-4c66-ac52-91c0082f6473 req-eb1c1cd9-6b27-4e6c-a7c9-be84fe4cdc40 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0485501 Nov 11 14:26:25.953292 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-c191bfaf-4b25-43a6-8b04-3f1674bf31f1 service neutron] 10.222.0.10 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922709 Nov 11 14:26:26.001211 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d77b91d7-da20-4c66-ac52-91c0082f6473 req-42396ab5-1b40-4d3a-a2db-bd22dee14f39 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504296 Nov 11 14:26:26.023646 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34970) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:26.048919 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-a2b79745-2ae7-45e3-8ffa-574a35402d84 service neutron] 10.222.0.10 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888004 Nov 11 14:26:26.215601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08dafdad-daea-4bb8-b78d-12ac2f23a163 tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:26.217095 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-08dafdad-daea-4bb8-b78d-12ac2f23a163 tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1094 time: 0.1922531 Nov 11 14:26:26.220079 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 34974) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:26.224696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'port_id': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:26.289982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:26.374255 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-484f7905-090b-4d98-ae37-3dc702209bec req-15b07407-e488-4af2-ab0a-0b48e1282ce9 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 210 time: 0.0554171 Nov 11 14:26:26.433733 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:26.506330 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa771b3-a62d-42f2-bf28-b915cb4fd2e0 req-d588b09f-00d0-455b-974f-e6054973d94c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:26.507956 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-aaa771b3-a62d-42f2-bf28-b915cb4fd2e0 req-d588b09f-00d0-455b-974f-e6054973d94c tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0504599 Nov 11 14:26:26.558608 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.27.1.210 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/1b977a10-3647-4111-a2a8-5568fd629dd4) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:26.564440 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-aaa771b3-a62d-42f2-bf28-b915cb4fd2e0 req-2c1f74ac-4118-422d-92c0-0ae49f07bb19 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497925 Nov 11 14:26:26.664698 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:26.735606 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:26.773854 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:26.780516 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:26.786588 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:26.792051 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=1b977a10-3647-4111-a2a8-5568fd629dd4,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:26.895960 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-eceea36b-c980-4cdf-a298-28370d4821b7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:26.897166 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-eceea36b-c980-4cdf-a298-28370d4821b7 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 945 time: 0.0546064 Nov 11 14:26:27.002221 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Deleting port 1676270a-314b-482b-a80f-f262b7204376 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:26:27.002562 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.308747 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] For port 1676270a-314b-482b-a80f-f262b7204376, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=1676270a-314b-482b-a80f-f262b7204376,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:27.309108 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.321655 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Calling delete_port for 1676270a-314b-482b-a80f-f262b7204376 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:26:27.358437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.472879 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a856d77c-971b-47dd-a9fe-ac71900ac7aa req-009ec8b1-47a3-44ab-9b3b-9fe639a885e4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 210 time: 0.0328479 Nov 11 14:26:27.537766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.540207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.551874 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['d3c800de-17fd-4c53-9b7d-1fcce1047246', '1676270a-314b-482b-a80f-f262b7204376'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:26:27.576228 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Pushing event deleted for resources: {'Port': ['ID=1676270a-314b-482b-a80f-f262b7204376,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:27.640967 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] No DVR routers for this DVR port 1676270a-314b-482b-a80f-f262b7204376 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:26:27.643790 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.647585 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-47c711dc-43f0-4d36-a7d7-6afa4a05efb6 req-5492d895-ee95-414a-b5c0-0a9e9763f1cf tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "DELETE /v2.0/ports/1676270a-314b-482b-a80f-f262b7204376 HTTP/1.1" status: 204 len: 173 time: 0.7424505 Nov 11 14:26:27.648072 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'name': 'network-vif-deleted', 'tag': '1676270a-314b-482b-a80f-f262b7204376'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:27.651830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84a93b64-d2db-48d0-a959-8fe7cf305824" -d '{"events": [{"server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "name": "network-vif-deleted", "tag": "1676270a-314b-482b-a80f-f262b7204376"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:27.710955 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98f47eab-c560-490a-83ea-2ce8770e23b1 x-openstack-request-id: req-98f47eab-c560-490a-83ea-2ce8770e23b1 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:27.711860 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "758079e1-6605-445d-8973-3e12079a3fa0", "name": "network-vif-deleted", "tag": "1676270a-314b-482b-a80f-f262b7204376", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:27.712298 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-98f47eab-c560-490a-83ea-2ce8770e23b1 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:27.713479 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '758079e1-6605-445d-8973-3e12079a3fa0', 'name': 'network-vif-deleted', 'tag': '1676270a-314b-482b-a80f-f262b7204376', 'status': 'completed', 'code': 200} Nov 11 14:26:27.776500 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.863037 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c894d4fd-2ad6-4380-9037-e3590417a92d req-054f7b47-540f-43dc-b0c7-a73e74c4538b tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0318294 Nov 11 14:26:27.863842 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.914764 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:27.954433 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=1b977a10-3647-4111-a2a8-5568fd629dd4,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:28.028910 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP a694a2ce-d3e1-4299-958e-45c6bc8c4054 associated. External IP: 172.27.1.210, port: a304cf63-faf2-4bfa-964d-9112da652ad0. Nov 11 14:26:28.238111 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:26:28.355023 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:26:28.366053 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:26:28.375572 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:28.376169 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:28.486451 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:28.491352 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:28.535020 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-893c4996-4b64-4d45-98b0-ffe434ef3f7e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.3138618 Nov 11 14:26:28.535848 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:28.538864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3" -d '{"events": [{"name": "network-changed", "server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:28.597870 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0a66eb39-eebd-4145-842a-75866d3af82c req-400f43c6-35c4-487d-b89c-9a0ad1416dad tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 210 time: 0.0378125 Nov 11 14:26:28.601845 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74ffa058-628b-4a4b-a7d2-a061a4822749 x-openstack-request-id: req-74ffa058-628b-4a4b-a7d2-a061a4822749 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:28.602158 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:28.603167 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-74ffa058-628b-4a4b-a7d2-a061a4822749 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:28.603769 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'status': 'completed', 'code': 200} Nov 11 14:26:28.630177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-37eaa7d7-b947-4fbf-858f-6c719a817dff tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:28.630177 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-37eaa7d7-b947-4fbf-858f-6c719a817dff tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 814 time: 0.1512437 Nov 11 14:26:28.657751 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'port': {'device_id': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'admin_state_up': True, 'tenant_id': '43dc465eb95943ee921d1e983a7e0320'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:28.707035 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-a29f1bb7-4f74-46c0-b499-6b0b1c7add3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:28.708735 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-a29f1bb7-4f74-46c0-b499-6b0b1c7add3d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1099 time: 0.0540121 Nov 11 14:26:28.743842 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'a694a2ce-d3e1-4299-958e-45c6bc8c4054', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:d1:27:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:26:27Z', 'updated_at': '2021-11-11T14:26:27Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:28.770113 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:28.780319 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:28.781198 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:28.819773 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-4c9e3d9a-32e3-4598-9be2-211fddc9e061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:28.821264 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-4c9e3d9a-32e3-4598-9be2-211fddc9e061 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.1042473 Nov 11 14:26:28.878209 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Made reservation on behalf of 43dc465eb95943ee921d1e983a7e0320 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:28.882170 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:28.890188 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:28.952502 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-4a858564-5b0e-4084-b50c-db24fa02702a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 200 len: 1000 time: 0.1058321 Nov 11 14:26:29.041213 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e1ac4865-037f-4fcb-8074-e907e643f299 req-92db523e-eecc-4c8a-9281-19dc35f6f676 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=758079e1-6605-445d-8973-3e12079a3fa0 HTTP/1.1" status: 200 len: 210 time: 0.0470817 Nov 11 14:26:29.079609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-78a82526-1e8c-4ccc-bea6-e52207dfd962 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:29.081206 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-78a82526-1e8c-4ccc-bea6-e52207dfd962 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.1030965 Nov 11 14:26:29.105222 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Allocated IP 172.20.0.3 (974515c5-e282-45f9-84fa-971ce619e2ed/7c279c15-72b2-4ea5-aa18-273542134660/c53a8d64-6f5c-4000-90d7-691eb1341d9a) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:26:29.187785 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-73ac3095-9f8c-4b6b-9f7e-62e72f65f131 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:29.193084 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-73ac3095-9f8c-4b6b-9f7e-62e72f65f131 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0993919 Nov 11 14:26:29.256133 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'a694a2ce-d3e1-4299-958e-45c6bc8c4054', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:d1:27:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:26:27Z', 'updated_at': '2021-11-11T14:26:27Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:29.287557 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f79a0d0b-08a9-4e06-b4d8-9b3f3d2ecc64 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': 'a694a2ce-d3e1-4299-958e-45c6bc8c4054', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:d1:27:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:26:27Z', 'updated_at': '2021-11-11T14:26:27Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:29.348439 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-926b3908-331a-4e93-9a8b-9ffce978a68f service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1440916 Nov 11 14:26:29.360619 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:29.477386 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f7d3a6d-567b-42ae-ba06-02bb2d6253e3 req-d1f99224-9dc3-4213-b364-3efbf0d1465d service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1170051 Nov 11 14:26:29.508576 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:29.576697 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Network 974515c5-e282-45f9-84fa-971ce619e2ed is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:26:29.582614 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:29.589332 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:26:29.595086 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:29.640153 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e303bc6b-52ff-435c-bc9d-51636a72281f None None] New status for floating IP a694a2ce-d3e1-4299-958e-45c6bc8c4054: ACTIVE {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:26:29.680160 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:29.680813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:29.800618 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-8cf98923-388f-4a30-b234-bfa9c28de43e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1465344 Nov 11 14:26:29.851713 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c051a553-a89b-455f-8c45-9c1d89bd1cb3 req-8a770721-07ea-43e3-bce7-4a55b48cf77f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:29.859949 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c051a553-a89b-455f-8c45-9c1d89bd1cb3 req-8a770721-07ea-43e3-bce7-4a55b48cf77f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.1636720 Nov 11 14:26:29.957737 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c051a553-a89b-455f-8c45-9c1d89bd1cb3 req-1272d44a-3f28-41bd-ac46-0a227f328297 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913658 Nov 11 14:26:29.984348 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7a1ba148-b36a-4ed5-9553-e81de5d69e1b None None] Provisioning complete for port c53a8d64-6f5c-4000-90d7-691eb1341d9a triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:29.985006 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7a1ba148-b36a-4ed5-9553-e81de5d69e1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:30.061586 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-7a1ba148-b36a-4ed5-9553-e81de5d69e1b None None] Port c53a8d64-6f5c-4000-90d7-691eb1341d9a cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:26:30.085450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 1676270a-314b-482b-a80f-f262b7204376 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:26:30.112669 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 1676270a-314b-482b-a80f-f262b7204376 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:26:30.113264 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 1676270a-314b-482b-a80f-f262b7204376 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:26:30.355676 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:26:30.632217 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a355674-e7d8-48c2-b552-266319a9e861 req-719c50ee-3bd2-49ed-a5ae-64ffc7a0cdac tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:30.633668 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2a355674-e7d8-48c2-b552-266319a9e861 req-719c50ee-3bd2-49ed-a5ae-64ffc7a0cdac tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0509677 Nov 11 14:26:30.683440 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2a355674-e7d8-48c2-b552-266319a9e861 req-de3a24a2-5a53-46ee-8668-0df70bd0ac60 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438459 Nov 11 14:26:31.080794 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce7fd9f-ba64-49f0-b77e-bb54796866a9 req-c8656d6c-d217-4d64-8cec-0d2c6ee5b91d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:31.082280 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8ce7fd9f-ba64-49f0-b77e-bb54796866a9 req-c8656d6c-d217-4d64-8cec-0d2c6ee5b91d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0537059 Nov 11 14:26:31.140244 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8ce7fd9f-ba64-49f0-b77e-bb54796866a9 req-5e3c334e-a058-41a0-b638-12ceece5b84e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519531 Nov 11 14:26:31.809533 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e146c6-0b29-42ec-8213-d15cfb298dea req-4473c7ba-5c2b-4a01-90b0-3dfdad1ebaa8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:31.810926 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-72e146c6-0b29-42ec-8213-d15cfb298dea req-4473c7ba-5c2b-4a01-90b0-3dfdad1ebaa8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0527337 Nov 11 14:26:31.861280 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-72e146c6-0b29-42ec-8213-d15cfb298dea req-ab0889cf-46fe-4c2e-a76a-41a0274b6e91 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442824 Nov 11 14:26:32.257684 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfcab747-af37-48fb-bb9e-f383899e8783 req-38d9f20c-1ec8-42ee-afa7-0d65ae03cd1a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:32.262455 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bfcab747-af37-48fb-bb9e-f383899e8783 req-38d9f20c-1ec8-42ee-afa7-0d65ae03cd1a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0543985 Nov 11 14:26:32.311957 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bfcab747-af37-48fb-bb9e-f383899e8783 req-3d53ede5-c141-4d7c-94a9-a0339283a1ea tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459344 Nov 11 14:26:32.981379 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d04c89-89b4-43ef-905e-f070076c047a req-27d56000-1cf6-4b90-8170-dc81a7193344 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:32.983036 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-45d04c89-89b4-43ef-905e-f070076c047a req-27d56000-1cf6-4b90-8170-dc81a7193344 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0505791 Nov 11 14:26:33.031676 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-45d04c89-89b4-43ef-905e-f070076c047a req-95c16538-9c66-4458-a92f-f0ab2e338cec tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426004 Nov 11 14:26:33.427267 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90317f5e-d81c-4a28-a4e1-272806e9523f req-593d13f2-6730-48a2-b394-a323831bb91b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:33.428759 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-90317f5e-d81c-4a28-a4e1-272806e9523f req-593d13f2-6730-48a2-b394-a323831bb91b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0500729 Nov 11 14:26:33.478773 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-90317f5e-d81c-4a28-a4e1-272806e9523f req-575504be-0a60-4e7b-b58e-51aa76ea51aa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437627 Nov 11 14:26:34.151772 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55c03edc-87c8-460b-9ba6-a6b499a23b80 req-311233b5-c512-43a0-bbc7-247df395c83d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:34.153220 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-55c03edc-87c8-460b-9ba6-a6b499a23b80 req-311233b5-c512-43a0-bbc7-247df395c83d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0527349 Nov 11 14:26:34.202614 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-55c03edc-87c8-460b-9ba6-a6b499a23b80 req-79bb8c3e-0053-40f4-a520-993c939aa29d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426834 Nov 11 14:26:34.592404 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2daace27-dfb4-4c61-a488-0e7d74b870a4 req-c2569531-b255-4cdb-bad9-97b7723fedf3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:34.593883 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2daace27-dfb4-4c61-a488-0e7d74b870a4 req-c2569531-b255-4cdb-bad9-97b7723fedf3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0498273 Nov 11 14:26:34.645447 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2daace27-dfb4-4c61-a488-0e7d74b870a4 req-7c67f4de-0b75-4374-a105-b710a0e60fbd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452621 Nov 11 14:26:35.321843 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d62524-518e-4743-9ebb-a62b5f2c3ff4 req-2b3492bd-ffc6-4182-a938-528eb777981d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:35.323537 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-95d62524-518e-4743-9ebb-a62b5f2c3ff4 req-2b3492bd-ffc6-4182-a938-528eb777981d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0538199 Nov 11 14:26:35.377498 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-95d62524-518e-4743-9ebb-a62b5f2c3ff4 req-38aaa906-c90e-4fcb-99a3-c85b4414d3a8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453756 Nov 11 14:26:35.785570 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d259ec10-e893-4c10-ba39-32c41de42536 req-3ed99e1b-1ebe-4dd9-b9c4-f69e9895776f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:35.787119 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d259ec10-e893-4c10-ba39-32c41de42536 req-3ed99e1b-1ebe-4dd9-b9c4-f69e9895776f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0605392 Nov 11 14:26:35.842788 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d259ec10-e893-4c10-ba39-32c41de42536 req-ed02bae7-8627-4db2-800e-56f6a380305e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477481 Nov 11 14:26:36.369027 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0fec879b-83c9-4a63-8df5-35492f6c24a9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:36.503099 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ce701f-2841-423d-9496-4ebd383a6834 req-41d6c76a-8312-47b3-bf8b-c8590a492f0d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:36.504723 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28ce701f-2841-423d-9496-4ebd383a6834 req-41d6c76a-8312-47b3-bf8b-c8590a492f0d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0512755 Nov 11 14:26:36.564181 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28ce701f-2841-423d-9496-4ebd383a6834 req-9d48f2f1-9c83-4047-8505-eff712ea79f5 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521624 Nov 11 14:26:37.005962 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7ce7aa-36e1-4e61-9e5e-6a998846db9c req-4a674af3-8458-4abe-8874-2ca97abd7aea tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:37.007574 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f7ce7aa-36e1-4e61-9e5e-6a998846db9c req-4a674af3-8458-4abe-8874-2ca97abd7aea tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0561125 Nov 11 14:26:37.066753 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f7ce7aa-36e1-4e61-9e5e-6a998846db9c req-e6dbe0ce-0613-4bd1-90de-ee98aeec4b42 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528708 Nov 11 14:26:38.471983 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e506760d-e8de-4411-a9a1-6295761a759b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:39.620415 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:40.848751 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:41.683835 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:42.009443 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:42.393723 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Request body: {'port': {'device_id': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:42.449541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:42.630320 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89d037c-a927-4eeb-ac5e-f1b092c94c4c req-9f392634-df65-4bfa-8a1a-1f31ef00310d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:42.631794 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d89d037c-a927-4eeb-ac5e-f1b092c94c4c req-9f392634-df65-4bfa-8a1a-1f31ef00310d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0805707 Nov 11 14:26:42.722789 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d89d037c-a927-4eeb-ac5e-f1b092c94c4c req-79d878a5-7dbd-41b9-aee3-0999fba9b2d2 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634871 Nov 11 14:26:42.786367 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c53a8d64-6f5c-4000-90d7-691eb1341d9a {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:26:42.795638 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:42.830660 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Transition to ACTIVE for port object c53a8d64-6f5c-4000-90d7-691eb1341d9a will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:26:42.850032 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157e1cb6-dd40-42d9-8ffd-edeb3ea94a62 req-69eb3b5c-6331-4327-b446-a188fe7b28ef tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:42.851881 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-157e1cb6-dd40-42d9-8ffd-edeb3ea94a62 req-69eb3b5c-6331-4327-b446-a188fe7b28ef tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 931 time: 0.0580139 Nov 11 14:26:42.899967 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-157e1cb6-dd40-42d9-8ffd-edeb3ea94a62 req-c928454a-031f-4d7c-a578-6b1b0ec86534 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416994 Nov 11 14:26:42.901192 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:42.953233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:43.034099 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Attempting to bind port c53a8d64-6f5c-4000-90d7-691eb1341d9a on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:26:43.034374 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Attempting to bind port c53a8d64-6f5c-4000-90d7-691eb1341d9a by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:26:43.034791 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Attempting to bind port c53a8d64-6f5c-4000-90d7-691eb1341d9a on network 974515c5-e282-45f9-84fa-971ce619e2ed {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:43.040612 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Port c53a8d64-6f5c-4000-90d7-691eb1341d9a on network 974515c5-e282-45f9-84fa-971ce619e2ed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:26:43.041016 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Attempting to bind port c53a8d64-6f5c-4000-90d7-691eb1341d9a on network 974515c5-e282-45f9-84fa-971ce619e2ed {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:26:43.046347 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 26, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:26:43.046795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Checking segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:43.047199 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Bound using segment: {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:26:43.049925 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Bound port: c53a8d64-6f5c-4000-90d7-691eb1341d9a, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e4a3441b-73d8-49a9-8956-724958d2a291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:26:43.049925 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:43.137798 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:26:43.142877 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:26:43.250324 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:43.286572 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.287252 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:43.288649 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] 10.222.0.11 "PUT /v2.0/ports/c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 1093 time: 0.8993573 Nov 11 14:26:43.289089 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:43.292129 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c15f147-127f-446d-a9e4-899ff688114d" -d '{"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:43.329642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdad951-51a3-4f6b-9b3e-8444cad6881a service neutron] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:43.348805 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8013c0e9-a6ba-461e-88ee-fd65587173a1 x-openstack-request-id: req-8013c0e9-a6ba-461e-88ee-fd65587173a1 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:43.349091 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:43.349341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-8013c0e9-a6ba-461e-88ee-fd65587173a1 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:43.349738 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:26:43.429638 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15f147-127f-446d-a9e4-899ff688114d req-d1aaf7b2-5226-4682-be34-1a74162455e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.431753 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3c15f147-127f-446d-a9e4-899ff688114d req-d1aaf7b2-5226-4682-be34-1a74162455e2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1096 time: 0.0482612 Nov 11 14:26:43.541145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15f147-127f-446d-a9e4-899ff688114d req-a0fe0e36-d1e7-489a-942b-cf2455b5ddc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.542645 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3c15f147-127f-446d-a9e4-899ff688114d req-a0fe0e36-d1e7-489a-942b-cf2455b5ddc4 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=43dc465eb95943ee921d1e983a7e0320&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1001599 Nov 11 14:26:43.657355 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15f147-127f-446d-a9e4-899ff688114d req-27033ed2-1579-4a16-b766-4ec0f0362e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.658838 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3c15f147-127f-446d-a9e4-899ff688114d req-27033ed2-1579-4a16-b766-4ec0f0362e11 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1035395 Nov 11 14:26:43.758280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-49188af4-2d25-4ac4-8173-a7b6ccfcb0e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.759850 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-49188af4-2d25-4ac4-8173-a7b6ccfcb0e6 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1096 time: 0.0428119 Nov 11 14:26:43.813869 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-25ac1173-2add-4d41-9662-01190f8694ee service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 217 time: 0.0358460 Nov 11 14:26:43.847273 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba005611-fc6c-4681-a95f-2e983b35fd52 req-5176eecd-dc22-4526-a40a-295f478d30ec tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.848779 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba005611-fc6c-4681-a95f-2e983b35fd52 req-5176eecd-dc22-4526-a40a-295f478d30ec tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0502250 Nov 11 14:26:43.867115 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-aa764290-207b-424d-b051-6cdfdc8f2e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.869364 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-aa764290-207b-424d-b051-6cdfdc8f2e32 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.0475466 Nov 11 14:26:43.902255 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ba005611-fc6c-4681-a95f-2e983b35fd52 req-b8ed5e66-4164-4827-b52e-b79d43625edc tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465641 Nov 11 14:26:43.932469 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-2f21ab5c-bc70-454b-b857-96b56c054783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:43.934187 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-2f21ab5c-bc70-454b-b857-96b56c054783 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0480378 Nov 11 14:26:44.064660 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-5e92569d-4a58-4e0a-9e9b-8c8fc11df789 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1170635 Nov 11 14:26:44.073104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c216f9ed-5fe5-4952-951f-8e92638d9e0c req-1b8ff6f2-2887-4a54-8fe8-a16c50add752 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:44.074472 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c216f9ed-5fe5-4952-951f-8e92638d9e0c req-1b8ff6f2-2887-4a54-8fe8-a16c50add752 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 943 time: 0.0748849 Nov 11 14:26:44.173100 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c216f9ed-5fe5-4952-951f-8e92638d9e0c req-eab57603-2707-49d8-8197-d0a370549a50 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892527 Nov 11 14:26:44.199971 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-48e3b453-1bf5-4088-a5e4-b09c75bcbf5f req-6c903c85-e1ec-4131-b5fd-bfd3f2031fa9 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1230130 Nov 11 14:26:45.016808 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd17bb35-442d-4980-b670-73b5443cacd7 req-440aa4f8-3be6-4024-9bee-e9e7614f5a7a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:45.018222 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cd17bb35-442d-4980-b670-73b5443cacd7 req-440aa4f8-3be6-4024-9bee-e9e7614f5a7a tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0499313 Nov 11 14:26:45.063578 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cd17bb35-442d-4980-b670-73b5443cacd7 req-63fdc48d-e2ca-48af-b6ac-33c306138db0 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395732 Nov 11 14:26:45.294870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0d3948-2ced-4f22-8d41-d1c13099431a req-25af85b9-c23c-4fa4-bf64-ac801c376d70 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:45.296348 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bf0d3948-2ced-4f22-8d41-d1c13099431a req-25af85b9-c23c-4fa4-bf64-ac801c376d70 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 943 time: 0.0514960 Nov 11 14:26:45.344431 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bf0d3948-2ced-4f22-8d41-d1c13099431a req-fa69c019-8e06-4764-ac51-32db4f726855 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422506 Nov 11 14:26:46.177437 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9b79a3-e4df-45ad-a3db-bcc5a85c8cd2 req-f11ef5f9-53d2-45c9-b644-9b60add9487e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:46.178930 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0d9b79a3-e4df-45ad-a3db-bcc5a85c8cd2 req-f11ef5f9-53d2-45c9-b644-9b60add9487e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0494938 Nov 11 14:26:46.224805 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0d9b79a3-e4df-45ad-a3db-bcc5a85c8cd2 req-103469ae-56c6-497f-906b-61d052bde6ff tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397949 Nov 11 14:26:46.361451 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245cbd7c-9b50-4093-8dae-17e29f1df352 req-de45a981-c234-4cf8-8f12-db0b4ec36f4f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:46.363595 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-245cbd7c-9b50-4093-8dae-17e29f1df352 req-de45a981-c234-4cf8-8f12-db0b4ec36f4f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0540667 Nov 11 14:26:46.411220 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-245cbd7c-9b50-4093-8dae-17e29f1df352 req-726fdde9-4f15-44c5-958f-325ddb3bea0c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416615 Nov 11 14:26:46.458766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5a5489-0391-4a93-8f04-03ed208de3ee req-4b59a4f8-494f-441d-8c7c-33fd49b70f45 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:46.460230 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6c5a5489-0391-4a93-8f04-03ed208de3ee req-4b59a4f8-494f-441d-8c7c-33fd49b70f45 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 943 time: 0.0472016 Nov 11 14:26:46.505396 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6c5a5489-0391-4a93-8f04-03ed208de3ee req-b1a0bf99-097a-4099-bdae-0bb687b6a1c7 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387673 Nov 11 14:26:47.349658 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b93259-910d-4b64-82c3-911f8db06375 req-900064b9-3b5d-40ae-8655-660d1f60b0c8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:47.351125 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c6b93259-910d-4b64-82c3-911f8db06375 req-900064b9-3b5d-40ae-8655-660d1f60b0c8 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0481150 Nov 11 14:26:47.398407 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c6b93259-910d-4b64-82c3-911f8db06375 req-1a010fe7-37d9-4408-abf1-9b9aa8a2c109 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407221 Nov 11 14:26:47.528837 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c875e58-7913-4935-86bb-041a932c74a9 req-745a1402-3a6d-4aa1-bbf4-3a31de0506ae tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:47.530287 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5c875e58-7913-4935-86bb-041a932c74a9 req-745a1402-3a6d-4aa1-bbf4-3a31de0506ae tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0475202 Nov 11 14:26:47.579836 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5c875e58-7913-4935-86bb-041a932c74a9 req-a84bb9d6-e447-4543-8de0-5a6394641994 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436776 Nov 11 14:26:47.617376 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cea01d5-e296-4e6a-9151-e80f87c15f59 req-36050773-f259-4f6b-8e22-2f30e14fc6e0 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:47.618842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6cea01d5-e296-4e6a-9151-e80f87c15f59 req-36050773-f259-4f6b-8e22-2f30e14fc6e0 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 943 time: 0.0479364 Nov 11 14:26:47.669097 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6cea01d5-e296-4e6a-9151-e80f87c15f59 req-b031be85-430d-4684-9538-08c018fca338 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432167 Nov 11 14:26:48.194308 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device c53a8d64-6f5c-4000-90d7-691eb1341d9a details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:26:48.400887 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:48.411971 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'port_id': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'mac_address': 'fa:16:3e:f3:ce:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 332, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:26:48.449779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:48.462569 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c53a8d64-6f5c-4000-90d7-691eb1341d9a {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:26:48.481943 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:48.513317 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb7d4f0a-9193-4d50-aa97-f18100326750 req-61acdd28-9e1d-40b4-8a2d-7c91e7a40e9d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:48.514751 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb7d4f0a-9193-4d50-aa97-f18100326750 req-61acdd28-9e1d-40b4-8a2d-7c91e7a40e9d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0479667 Nov 11 14:26:48.551401 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:48.562918 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb7d4f0a-9193-4d50-aa97-f18100326750 req-93a6dc02-3ee0-4e15-8546-3269b7ce9a1e tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/security-groups?id=0b32fc76-1541-4148-b387-a4fcf019d3db&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421762 Nov 11 14:26:48.597674 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:48.696818 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7cca42d-444d-413b-be3e-6d4eaa6547b7 req-6bebfa97-82f0-4ec1-b1dd-fbd0b9be882d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:48.698276 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b7cca42d-444d-413b-be3e-6d4eaa6547b7 req-6bebfa97-82f0-4ec1-b1dd-fbd0b9be882d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0464902 Nov 11 14:26:48.745862 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b7cca42d-444d-413b-be3e-6d4eaa6547b7 req-be0ecbff-9652-4a61-b00e-a3b63439731d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418975 Nov 11 14:26:48.788245 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f5bee0-5445-4643-b0fd-80eedb6a5ff9 req-87f99591-b407-4f36-8b90-c1af745252d3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:48.789898 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f2f5bee0-5445-4643-b0fd-80eedb6a5ff9 req-87f99591-b407-4f36-8b90-c1af745252d3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 944 time: 0.0503342 Nov 11 14:26:48.837855 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f2f5bee0-5445-4643-b0fd-80eedb6a5ff9 req-128b88f6-537d-4f2f-9a7a-def47425b54a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406144 Nov 11 14:26:48.875748 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:26:48.946996 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-d7976a40-1031-4362-99f3-352fb8bd0f39 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:48.948502 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-d7976a40-1031-4362-99f3-352fb8bd0f39 tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 946 time: 0.0475144 Nov 11 14:26:49.044513 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Deleting port d3c800de-17fd-4c53-9b7d-1fcce1047246 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:26:49.044844 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:49.129079 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] For port d3c800de-17fd-4c53-9b7d-1fcce1047246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=d3c800de-17fd-4c53-9b7d-1fcce1047246,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:49.129440 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:49.141891 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Calling delete_port for d3c800de-17fd-4c53-9b7d-1fcce1047246 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:26:49.334145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:49.360910 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Pushing event deleted for resources: {'Port': ['ID=d3c800de-17fd-4c53-9b7d-1fcce1047246,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:49.374255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.374622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.374965 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.375298 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.375654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.375978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.376298 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.376615 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.376933 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.377297 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.377569 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.377885 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:49.416757 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] No DVR routers for this DVR port d3c800de-17fd-4c53-9b7d-1fcce1047246 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:26:49.419235 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:49.422568 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2abd7962-1006-4437-947a-d0b1390d4f2b req-c5a6d79a-5331-4165-b318-9bf75d402a8d tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.11 "DELETE /v2.0/ports/d3c800de-17fd-4c53-9b7d-1fcce1047246 HTTP/1.1" status: 204 len: 173 time: 0.4649961 Nov 11 14:26:49.423008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'name': 'network-vif-deleted', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:49.425294 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7362a35-b3ba-4d46-a369-c8c9f957cb49" -d '{"events": [{"server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "name": "network-vif-deleted", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:49.442574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['d3c800de-17fd-4c53-9b7d-1fcce1047246'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:26:49.470631 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f2700e6-0200-43e1-8133-6774f0c9bce2 x-openstack-request-id: req-8f2700e6-0200-43e1-8133-6774f0c9bce2 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:49.470930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98a333d2-b3d6-4e82-aa69-158dd01add6d", "name": "network-vif-deleted", "tag": "d3c800de-17fd-4c53-9b7d-1fcce1047246", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:49.476127 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-8f2700e6-0200-43e1-8133-6774f0c9bce2 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:49.476127 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98a333d2-b3d6-4e82-aa69-158dd01add6d', 'name': 'network-vif-deleted', 'tag': 'd3c800de-17fd-4c53-9b7d-1fcce1047246', 'status': 'completed', 'code': 200} Nov 11 14:26:49.663244 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7b23f828-682c-468e-af14-1fb4d73faa14 req-1829efe9-436a-4900-8e32-f867b39aa0de tempest-ServerRescueNegativeTestJSON-654003721 tempest-ServerRescueNegativeTestJSON-654003721-project] 10.222.0.10 "GET /v2.0/ports?device_id=98a333d2-b3d6-4e82-aa69-158dd01add6d HTTP/1.1" status: 200 len: 210 time: 0.0301931 Nov 11 14:26:49.868066 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5715d7bc-c8da-44a8-a267-c3e6e2defb64 req-8532c8af-2234-43c5-adc4-80bbf47f0269 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:49.870511 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5715d7bc-c8da-44a8-a267-c3e6e2defb64 req-8532c8af-2234-43c5-adc4-80bbf47f0269 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0488081 Nov 11 14:26:49.919077 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5715d7bc-c8da-44a8-a267-c3e6e2defb64 req-94955720-eda4-4b8e-a0c9-607188868362 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433483 Nov 11 14:26:49.953393 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062b36fb-7fb5-400c-abe0-3a9942946142 req-a1256a5f-0fe7-493e-9c46-a2c37b9a7d02 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:49.954847 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-062b36fb-7fb5-400c-abe0-3a9942946142 req-a1256a5f-0fe7-493e-9c46-a2c37b9a7d02 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 944 time: 0.0486345 Nov 11 14:26:50.002531 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-062b36fb-7fb5-400c-abe0-3a9942946142 req-6cbd6309-fc6f-4ebd-8c34-6526acd4f51c tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416853 Nov 11 14:26:50.208485 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device c53a8d64-6f5c-4000-90d7-691eb1341d9a up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:26:50.317115 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port c53a8d64-6f5c-4000-90d7-691eb1341d9a completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:26:50.321757 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port c53a8d64-6f5c-4000-90d7-691eb1341d9a triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:26:50.322141 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:50.398424 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:50.421172 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:26:50.423424 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39a4de10-ce85-4408-9935-b6f443a112e2" -d '{"events": [{"server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "name": "network-vif-plugged", "status": "completed", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:26:50.436730 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:50.459541 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:26:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63020e0e-6cb5-49b2-b76c-a8e70bf69a51 x-openstack-request-id: req-63020e0e-6cb5-49b2-b76c-a8e70bf69a51 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:26:50.460179 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "name": "network-vif-plugged", "status": "completed", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:26:50.460179 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-63020e0e-6cb5-49b2-b76c-a8e70bf69a51 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:26:50.460488 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'code': 200} Nov 11 14:26:50.517214 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:50.571797 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:50.719688 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35208) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:50.756989 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-177675f1-ff3e-4f7c-98b4-47f40db51877 req-5f0a592b-1a2c-4283-8955-1748e9c88cf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:50.759064 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-177675f1-ff3e-4f7c-98b4-47f40db51877 req-5f0a592b-1a2c-4283-8955-1748e9c88cf9 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1098 time: 0.0394742 Nov 11 14:26:50.808496 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-177675f1-ff3e-4f7c-98b4-47f40db51877 req-83572815-433e-4237-9a31-b75829a71687 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417826 Nov 11 14:26:51.063826 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af7efad-70f3-4e9e-9a99-e0c59a40d219 req-28cce89d-57c1-4026-ab4c-57a7a20ce837 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:51.065714 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6af7efad-70f3-4e9e-9a99-e0c59a40d219 req-28cce89d-57c1-4026-ab4c-57a7a20ce837 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0590675 Nov 11 14:26:51.114871 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6af7efad-70f3-4e9e-9a99-e0c59a40d219 req-18dadcef-854a-445b-bfca-c325050bb72d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422413 Nov 11 14:26:51.168117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad88bb9-272a-4a00-bbcc-9417cd0dc155 req-baa87498-2ba9-4741-a5ce-8c60aa72d8b4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:51.169529 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fad88bb9-272a-4a00-bbcc-9417cd0dc155 req-baa87498-2ba9-4741-a5ce-8c60aa72d8b4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0872400 Nov 11 14:26:51.198336 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:51.261125 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fad88bb9-272a-4a00-bbcc-9417cd0dc155 req-5d8bbe13-eb1e-4e2d-b509-24f2ca994463 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837700 Nov 11 14:26:51.707616 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Deleting port 967def6c-cba2-47e2-9ab6-b715ae46915d {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:26:51.707949 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:51.792368 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] For port 967def6c-cba2-47e2-9ab6-b715ae46915d, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=967def6c-cba2-47e2-9ab6-b715ae46915d,segment=NetworkSegment(6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20),segment_id=6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:51.793033 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:51.804418 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Calling delete_port for 967def6c-cba2-47e2-9ab6-b715ae46915d owned by network:router_interface {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:26:52.094014 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:52.123593 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Pushing event deleted for resources: {'Port': ['ID=967def6c-cba2-47e2-9ab6-b715ae46915d,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:52.135602 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.135955 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.136294 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.136630 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.136962 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.137291 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.137618 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.137943 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.138302 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.138624 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.138950 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.139268 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:26:52.237382 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7680d3-851d-40b1-978a-fb7c2baea042 req-d65540d2-13c6-484f-ae61-fd3abe0dad21 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:52.239079 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9e7680d3-851d-40b1-978a-fb7c2baea042 req-d65540d2-13c6-484f-ae61-fd3abe0dad21 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0473773 Nov 11 14:26:52.255625 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:52.287672 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9e7680d3-851d-40b1-978a-fb7c2baea042 req-82f474b5-7c6d-4e5b-86e4-723727568408 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423615 Nov 11 14:26:52.404671 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b19b3bc-0899-47a1-af92-f9fc32146c39 req-7bc3d012-8b9c-4ea6-92e7-93b78bb1dae6 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:52.406140 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2b19b3bc-0899-47a1-af92-f9fc32146c39 req-7bc3d012-8b9c-4ea6-92e7-93b78bb1dae6 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0635858 Nov 11 14:26:52.520864 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2b19b3bc-0899-47a1-af92-f9fc32146c39 req-996e9fc7-6849-4339-b85d-4e95f2645881 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824516 Nov 11 14:26:52.541668 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:26:52.646624 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:26:52.653011 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ee041cbd-aa7a-4527-8548-8753373ec1f0 admin admin] 10.222.0.10 "PUT /v2.0/routers/16659e14-0fa0-4f58-8eaf-d4c08ef558c9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9322388 Nov 11 14:26:52.655512 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35222) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:52.658102 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Sync routers for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:26:52.669723 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:52.670326 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:52.757964 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks [] for router, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:52.771831 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:52.859943 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:52.946382 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:26:51Z', 'revision_number': 5, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port': {'id': 'b9e6fea4-f547-4d47-9255-9473815a73ca', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:72:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:23:33Z', 'updated_at': '2021-11-11T14:23:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:52.953389 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Deleting port b9e6fea4-f547-4d47-9255-9473815a73ca {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:26:52.953724 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:52.971909 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Checking router: 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:26:52.980261 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Routers {'16659e14-0fa0-4f58-8eaf-d4c08ef558c9'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:26:52.980980 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:26:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:53.039132 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] For port b9e6fea4-f547-4d47-9255-9473815a73ca, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b9e6fea4-f547-4d47-9255-9473815a73ca,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:26:53.039982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.053301 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Calling delete_port for b9e6fea4-f547-4d47-9255-9473815a73ca owned by network:router_gateway {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:26:53.145194 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] Set router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:26:53.195755 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:26:52Z', 'revision_number': 6, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:53.223542 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31439a7d-cd92-4ddf-a056-8524e401a8d8 None None] The sync data for ids ['16659e14-0fa0-4f58-8eaf-d4c08ef558c9'] in dv-cinder-777031-9-iscsi is: [{'id': '16659e14-0fa0-4f58-8eaf-d4c08ef558c9', 'name': 'tempest-ServerRescueNegativeTestJSON-2074477248-router', 'tenant_id': '81dcff4bc9f54a4dacd1740ab810742f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:23:32Z', 'updated_at': '2021-11-11T14:26:52Z', 'revision_number': 6, 'project_id': '81dcff4bc9f54a4dacd1740ab810742f', 'gw_port_host': None}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:26:53.265431 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.291801 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Pushing event deleted for resources: {'Port': ['ID=b9e6fea4-f547-4d47-9255-9473815a73ca,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:53.315641 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.407523 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d18ed3f-83b7-45dd-af71-134255737052 req-55fc9170-fdcd-4496-ae37-d78cf7ca9eb6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:53.409002 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d18ed3f-83b7-45dd-af71-134255737052 req-55fc9170-fdcd-4496-ae37-d78cf7ca9eb6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0488029 Nov 11 14:26:53.421098 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.423319 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.460374 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d18ed3f-83b7-45dd-af71-134255737052 req-f2a6c749-394a-492e-a24a-533216c03000 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444505 Nov 11 14:26:53.534135 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.534680 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 16659e14-0fa0-4f58-8eaf-d4c08ef558c9 {{(pid=102268) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:26:53.539627 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.540792 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-42b03d53-4bc6-440d-a041-e3624f865853 admin admin] 10.222.0.10 "DELETE /v2.0/routers/16659e14-0fa0-4f58-8eaf-d4c08ef558c9 HTTP/1.1" status: 204 len: 168 time: 0.8843787 Nov 11 14:26:53.543262 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35228) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:53.589397 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Deleting subnet 9d424b9f-e0e9-479a-ab04-c4aa25cf128d {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:26:53.594120 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.667534 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.675203 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.709265 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-486fc3b7-804b-49f5-af8a-e9ef2118247c req-a0281da8-d8b5-4020-88ea-3dfaf176e949 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:53.710694 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-486fc3b7-804b-49f5-af8a-e9ef2118247c req-a0281da8-d8b5-4020-88ea-3dfaf176e949 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.1190100 Nov 11 14:26:53.774092 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-486fc3b7-804b-49f5-af8a-e9ef2118247c req-cae6bd0a-e5f4-4292-893f-902343a40307 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562172 Nov 11 14:26:53.813958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.839579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9d424b9f-e0e9-479a-ab04-c4aa25cf128d,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:53.844337 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:53.847553 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bf4ddf86-99a2-4734-8849-102885b11084 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/9d424b9f-e0e9-479a-ab04-c4aa25cf128d HTTP/1.1" status: 204 len: 168 time: 0.3032460 Nov 11 14:26:53.849946 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35232) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:53.923711 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.011512 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.034818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.035296 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037127 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037127 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > port after_create 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037127 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > port after_delete 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037127 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > port after_update 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037488 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037679 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.037928 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.038168 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.091285 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b9e6fea4-f547-4d47-9255-9473815a73ca no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:26:54.104528 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.105000 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.105325 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.105645 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102268) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 11 14:26:54.106083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc415290-2d4a-450f-b1bb-bf8153b56614']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:54.112454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: b9e6fea4-f547-4d47-9255-9473815a73ca {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:26:54.112800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b9e6fea4-f547-4d47-9255-9473815a73ca not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:26:54.113221 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 967def6c-cba2-47e2-9ab6-b715ae46915d no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:26:54.125601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:54.125884 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d2b5d55-4c3a-4a30-ad9d-0f24109e9f20') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:26:54.132835 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 967def6c-cba2-47e2-9ab6-b715ae46915d {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:26:54.133224 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 967def6c-cba2-47e2-9ab6-b715ae46915d not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:26:54.145450 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.166894 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.176124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Releasing vlan 346 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:26:54.176344 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: from cryptography.utils import int_from_bytes Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: from cryptography.utils import int_from_bytes Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:26:54.180877 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:26:54.268178 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device d3c800de-17fd-4c53-9b7d-1fcce1047246 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:26:54.293880 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: d3c800de-17fd-4c53-9b7d-1fcce1047246 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:26:54.294417 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device d3c800de-17fd-4c53-9b7d-1fcce1047246 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:26:54.305638 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.313522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:54.320138 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] 10.222.0.10 "DELETE /v2.0/networks/bc415290-2d4a-450f-b1bb-bf8153b56614 HTTP/1.1" status: 204 len: 168 time: 0.4661059 Nov 11 14:26:54.334224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f32eda-f2e7-4923-a2f5-cbdcf006d4cc admin admin] Pushing event deleted for resources: {'Network': ['ID=bc415290-2d4a-450f-b1bb-bf8153b56614,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:54.577107 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839b61f6-dade-4a79-9aa3-da1accc38b02 req-74ac00b6-0e24-4495-99de-a5b6fade3f31 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:54.578626 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-839b61f6-dade-4a79-9aa3-da1accc38b02 req-74ac00b6-0e24-4495-99de-a5b6fade3f31 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0488548 Nov 11 14:26:54.626457 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-839b61f6-dade-4a79-9aa3-da1accc38b02 req-b793c16d-28ff-48f6-a75e-74fcd87c3888 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416265 Nov 11 14:26:54.662232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35240) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:54.702096 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-5de6e05e-f7d5-48f2-a86f-964d1cbba76d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=81dcff4bc9f54a4dacd1740ab810742f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0386224 Nov 11 14:26:54.704474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35242) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:55.001718 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:55.033809 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11904f13-6262-44d0-98b2-0f6fea5d098d req-58e80994-1d67-4233-a894-eaebff0475ce tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:55.035267 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-11904f13-6262-44d0-98b2-0f6fea5d098d req-58e80994-1d67-4233-a894-eaebff0475ce tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0748868 Nov 11 14:26:55.037068 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:55.105807 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-11904f13-6262-44d0-98b2-0f6fea5d098d req-53332b1c-f7ff-4c6e-9152-b0e80da18268 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622005 Nov 11 14:26:55.185591 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:55.188206 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:55.189327 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/0b32fc76-1541-4148-b387-a4fcf019d3db HTTP/1.1" status: 204 len: 168 time: 0.4839375 Nov 11 14:26:55.197987 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af57e5c4-b3b7-4224-b015-9cfefb094a9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b32fc76-1541-4148-b387-a4fcf019d3db,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:55.750543 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168497e1-924b-4d7d-b667-8e6d595bc5b1 req-09b3b55b-c0e1-4459-af07-37337c3f8f75 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:55.752149 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-168497e1-924b-4d7d-b667-8e6d595bc5b1 req-09b3b55b-c0e1-4459-af07-37337c3f8f75 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0535147 Nov 11 14:26:55.799432 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-168497e1-924b-4d7d-b667-8e6d595bc5b1 req-740c7592-c775-400e-910c-7aff6c024321 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414348 Nov 11 14:26:56.179931 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35276) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:56.221506 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf14f349-4cd9-490c-a2e7-dfde9ebe02a7 req-b1f597b0-681a-4a55-88cc-0cdca4bdfd92 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:56.222962 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bf14f349-4cd9-490c-a2e7-dfde9ebe02a7 req-b1f597b0-681a-4a55-88cc-0cdca4bdfd92 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0510604 Nov 11 14:26:56.269879 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bf14f349-4cd9-490c-a2e7-dfde9ebe02a7 req-48659a7a-42c6-4e1d-96c0-4b48c3334052 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410535 Nov 11 14:26:56.276745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-566765810-network', 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:56.348400 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:56.350427 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.376306 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.405578 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c510ad-2375-401d-84a6-1f9c57aba47a req-cfadfb6d-4c74-42c0-8fe7-b364790dde62 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:56.407039 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-04c510ad-2375-401d-84a6-1f9c57aba47a req-cfadfb6d-4c74-42c0-8fe7-b364790dde62 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0719495 Nov 11 14:26:56.477737 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-04c510ad-2375-401d-84a6-1f9c57aba47a req-fe793012-fe8b-4f72-8475-acdc3ef368cd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639389 Nov 11 14:26:56.499941 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.562408 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.587310 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 342} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:26:56.596223 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87303888-f648-400d-a8a2-f70720c6963f,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:56.600961 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.601307 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Added segment a261d729-bba1-440e-ba21-5fcca20345f3 of type vlan for network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 Nov 11 14:26:56.642255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.722319 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.723308 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:56.723946 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.811699 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6305711 Nov 11 14:26:56.812473 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ecc21db-318d-4c92-afcd-cedccdfb00bf admin admin] Pushing event updated for resources: {'Network': ['ID=46c60fd1-4f35-496c-adf1-1f850a03f8d7,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:56.814647 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35288) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:26:56.819456 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Request body: {'subnet': {'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-566765810-subnet', 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:26:56.823057 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:26:56.840540 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4864c7-0166-4db3-8b81-94113c60404c req-5023a477-c905-489c-85d6-6b891d44fd2c tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:56.842045 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3e4864c7-0166-4db3-8b81-94113c60404c req-5023a477-c905-489c-85d6-6b891d44fd2c tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0618482 Nov 11 14:26:56.900746 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3e4864c7-0166-4db3-8b81-94113c60404c req-87969f5b-09ec-4314-a2d8-a552b9ef4688 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527618 Nov 11 14:26:56.902220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:26:56.904551 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-129288590'] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:56.973851 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533996f7-9699-4b38-b279-3e1e062f01fb req-2ebacec5-6ee9-4c6b-9366-9a1a93d2ac3d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:56.975315 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-533996f7-9699-4b38-b279-3e1e062f01fb req-2ebacec5-6ee9-4c6b-9366-9a1a93d2ac3d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.1035211 Nov 11 14:26:57.045077 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-533996f7-9699-4b38-b279-3e1e062f01fb req-3e45a8ea-2e78-4de9-8a5d-87c7a08e2b68 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632908 Nov 11 14:26:57.191515 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-125906361', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-129288608'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:57.250901 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Pushing event updated for resources: {'Subnet': ['ID=8112b7d5-8b09-4390-bcfa-982686a4a63b,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:26:57.259985 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Checking segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:26:57.260334 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Network hostable DHCP agents. Network: 46c60fd1-4f35-496c-adf1-1f850a03f8d7, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:26:57.367818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:26:57.459354 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 46c60fd1-4f35-496c-adf1-1f850a03f8d7) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:26:57.464638 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:57.465298 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:26:57.471127 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40b642bf-27a7-4253-95b6-9401bb53f342 None None] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:26:57.548399 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bf5c1b8c-2f46-4722-8135-df748db2335c admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7326658 Nov 11 14:26:57.604742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b6ee782-7785-4dbf-b520-4af2d86e71ab None None] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:26:57.999590 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-92e7484b-ebc7-4246-94dd-d6056c44a2f1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:58.000946 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-92e7484b-ebc7-4246-94dd-d6056c44a2f1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1004007 Nov 11 14:26:58.015675 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-2f4047df-f053-46e5-9bfa-0e3f9eba654a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/quotas/58e5f180c3b54f9882a3b22f6f437768 HTTP/1.1" status: 200 len: 375 time: 0.0091619 Nov 11 14:26:58.045840 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-d82efef5-5528-4324-a145-02bb11113399 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0251019 Nov 11 14:26:58.142098 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-bd3ab304-275d-4715-b679-fbd323b1ee83 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895126 Nov 11 14:26:58.163692 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0112a35-303b-4b09-8449-7f5ea9c829ca req-754fa768-e8d7-406a-89f0-ff3f2fd592de tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:58.165205 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c0112a35-303b-4b09-8449-7f5ea9c829ca req-754fa768-e8d7-406a-89f0-ff3f2fd592de tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0492890 Nov 11 14:26:58.211573 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c0112a35-303b-4b09-8449-7f5ea9c829ca req-5583e6dc-2341-4d06-9dbf-713772d2ec33 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399623 Nov 11 14:26:58.231477 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-4313ba59-9615-4d91-a637-d96e5dffc1e5 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831766 Nov 11 14:26:58.474844 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e83768e6-8580-4935-8c46-d83708e95946 req-8c2c3d57-f80c-475f-9693-a11fb536195f tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0255616 Nov 11 14:26:59.344819 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7829b41-51c8-4632-83c6-adbfd394242a req-09b05a18-538a-4523-9c89-68075230be65 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:26:59.346278 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7829b41-51c8-4632-83c6-adbfd394242a req-09b05a18-538a-4523-9c89-68075230be65 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0558224 Nov 11 14:26:59.392587 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7829b41-51c8-4632-83c6-adbfd394242a req-1b4972a6-8e5b-4fd4-8164-312d03be5439 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401711 Nov 11 14:26:59.576033 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-98fbd521-6e45-4117-b1d0-acea56ab6f21 req-9164d1df-1f2c-4e06-a2e5-6c762465d0a8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0272484 Nov 11 14:27:00.513536 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b808b8e-a963-430f-9f66-4a1713aac3e0 req-1f28aae5-5294-4134-8ecc-d4aaed88cfda tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:00.515101 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8b808b8e-a963-430f-9f66-4a1713aac3e0 req-1f28aae5-5294-4134-8ecc-d4aaed88cfda tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0527699 Nov 11 14:27:00.560993 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8b808b8e-a963-430f-9f66-4a1713aac3e0 req-1e9db619-3338-469e-9652-c57f5af0c244 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402529 Nov 11 14:27:00.670972 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6a2b3b80-0686-4810-8d65-ab2ed1b24ba4 req-dbfced46-b62b-40d3-b5f3-0ed63cb62707 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0255806 Nov 11 14:27:01.682009 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7969fa2e-f6a1-4149-afa4-85c0c03f6594 req-fd078464-01d3-4a50-ad40-b67dc50a9a2f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:01.683509 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7969fa2e-f6a1-4149-afa4-85c0c03f6594 req-fd078464-01d3-4a50-ad40-b67dc50a9a2f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0527542 Nov 11 14:27:01.730670 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7969fa2e-f6a1-4149-afa4-85c0c03f6594 req-799febb3-501a-4158-8add-fd053b350df4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412304 Nov 11 14:27:01.763168 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d79649c0-d50e-4d06-8983-77119c54ded2 req-dae761d7-f424-4dab-91d4-caa391d7a0bc tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0257857 Nov 11 14:27:02.848821 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380c212c-6000-47c6-a7a1-1d18d46385c7 req-a987b4d1-db35-4da3-adda-0d5e67b31df9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:02.850212 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-380c212c-6000-47c6-a7a1-1d18d46385c7 req-a987b4d1-db35-4da3-adda-0d5e67b31df9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0480661 Nov 11 14:27:02.853966 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ee5e1559-53e5-493c-a467-e639f7ff5abf req-06b7ccc0-f60e-47db-9d3c-1573034277bb tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0250130 Nov 11 14:27:02.901338 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-380c212c-6000-47c6-a7a1-1d18d46385c7 req-53aa7fe4-fb13-4d31-af5e-11912c54ac18 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447242 Nov 11 14:27:03.361683 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-e453df4f-a51a-4f53-9a36-5f7f826ad533 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:03.363106 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-e453df4f-a51a-4f53-9a36-5f7f826ad533 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1049006 Nov 11 14:27:03.376638 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Request body: {'port': {'device_id': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'admin_state_up': True, 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:03.545816 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:27:03.549414 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:03.679777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Allocated IP 172.20.0.12 (46c60fd1-4f35-496c-adf1-1f850a03f8d7/8112b7d5-8b09-4390-bcfa-982686a4a63b/6f453929-a95f-4aeb-83e9-5b8a818d9859) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:27:04.012049 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-333a2b9e-81f2-4d8f-81ba-b0942b114d6c req-82f2a17a-c943-4e6e-9b9a-52c456510d68 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0418196 Nov 11 14:27:04.025366 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d216b3-a4bb-4c1b-8d41-6ed266f14d1c req-2d01a16f-4d4e-496a-9452-893184480d2a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:04.031881 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-04d216b3-a4bb-4c1b-8d41-6ed266f14d1c req-2d01a16f-4d4e-496a-9452-893184480d2a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0584300 Nov 11 14:27:04.059234 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.083539 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-04d216b3-a4bb-4c1b-8d41-6ed266f14d1c req-554abfca-cc09-4191-8795-dae23b4d2e25 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409389 Nov 11 14:27:04.145366 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.188848 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:27:04.193813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:27:04.197505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:27:04.223446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event updated for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:04.250973 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:04.251596 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.341742 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-ca17fb54-a635-40ad-88f5-cd510034ca99 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9689374 Nov 11 14:27:04.354845 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Request body: {'port': {'device_id': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:04.406157 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.658542 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f453929-a95f-4aeb-83e9-5b8a818d9859 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:04.666505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.678831 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Transition to ACTIVE for port object 6f453929-a95f-4aeb-83e9-5b8a818d9859 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:27:04.739008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.794840 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Pushing event updated for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:04.856695 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Attempting to bind port 6f453929-a95f-4aeb-83e9-5b8a818d9859 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:27:04.857024 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Attempting to bind port 6f453929-a95f-4aeb-83e9-5b8a818d9859 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:27:04.857349 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Attempting to bind port 6f453929-a95f-4aeb-83e9-5b8a818d9859 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:04.861475 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Port 6f453929-a95f-4aeb-83e9-5b8a818d9859 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:27:04.861790 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Attempting to bind port 6f453929-a95f-4aeb-83e9-5b8a818d9859 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:04.866473 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 26, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:27:04.866806 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Checking segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:27:04.867181 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Bound using segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:27:04.867630 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Bound port: 6f453929-a95f-4aeb-83e9-5b8a818d9859, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:27:04.867978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:04.927815 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:27:04.931158 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:27:05.019286 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:05.058589 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.063896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:05.063896 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] 10.222.0.11 "PUT /v2.0/ports/6f453929-a95f-4aeb-83e9-5b8a818d9859 HTTP/1.1" status: 200 len: 1094 time: 0.7096746 Nov 11 14:27:05.063896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:05.063896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db8b5370-59b0-4552-b160-feff0d409d10" -d '{"events": [{"name": "network-changed", "server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:05.106088 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c53ec3d-e87c-4a81-bfa1-02fb30eba43c x-openstack-request-id: req-6c53ec3d-e87c-4a81-bfa1-02fb30eba43c {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:05.106088 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:05.106088 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-6c53ec3d-e87c-4a81-bfa1-02fb30eba43c {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:05.106088 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859', 'status': 'completed', 'code': 200} Nov 11 14:27:05.106088 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f584d5b8-d506-4f3e-a9ff-c42ced7e338c service neutron] Pushing event updated for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:05.169395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97cc244-8c3d-47d7-a2d9-81c3a0ab3137 req-6e133cfc-ba3d-4fc1-89a6-f8ac8e4d9510 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.170914 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a97cc244-8c3d-47d7-a2d9-81c3a0ab3137 req-6e133cfc-ba3d-4fc1-89a6-f8ac8e4d9510 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 944 time: 0.0845516 Nov 11 14:27:05.188711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8b5370-59b0-4552-b160-feff0d409d10 req-88da5d82-a26f-45ec-a3da-97044bc6f795 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.190244 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-db8b5370-59b0-4552-b160-feff0d409d10 req-88da5d82-a26f-45ec-a3da-97044bc6f795 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 1097 time: 0.0650382 Nov 11 14:27:05.221949 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ad7f30-815f-4c72-a364-8968b798c499 req-6e457723-3131-45e9-8560-f5d4df10295b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.223467 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-86ad7f30-815f-4c72-a364-8968b798c499 req-6e457723-3131-45e9-8560-f5d4df10295b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0590065 Nov 11 14:27:05.275209 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-86ad7f30-815f-4c72-a364-8968b798c499 req-8a5928ec-bb71-4d8c-8bd9-77cdb68a9aca tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451970 Nov 11 14:27:05.280860 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a97cc244-8c3d-47d7-a2d9-81c3a0ab3137 req-155427cd-35be-40de-9231-bd4e004b882f tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007819 Nov 11 14:27:05.325756 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8b5370-59b0-4552-b160-feff0d409d10 req-86f68e59-d559-4fca-a9a5-b45ba941abe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.327202 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-db8b5370-59b0-4552-b160-feff0d409d10 req-86f68e59-d559-4fca-a9a5-b45ba941abe9 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=58e5f180c3b54f9882a3b22f6f437768&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1264675 Nov 11 14:27:05.424352 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8b5370-59b0-4552-b160-feff0d409d10 req-f583de2b-77dc-4a8b-ac86-daf375b2a8c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.425799 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-db8b5370-59b0-4552-b160-feff0d409d10 req-f583de2b-77dc-4a8b-ac86-daf375b2a8c2 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0916576 Nov 11 14:27:05.501144 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-cf4065ac-9ab3-40d9-bbce-7442d856391c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.502523 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-cf4065ac-9ab3-40d9-bbce-7442d856391c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 1097 time: 0.0412836 Nov 11 14:27:05.547732 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-dcd6acf0-0283-4093-8f05-344c09cb6510 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859 HTTP/1.1" status: 200 len: 217 time: 0.0339611 Nov 11 14:27:05.595402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-c629f281-f77b-449f-8d35-20a21cbc7d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:05.597802 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-c629f281-f77b-449f-8d35-20a21cbc7d4b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=8112b7d5-8b09-4390-bcfa-982686a4a63b HTTP/1.1" status: 200 len: 854 time: 0.0437765 Nov 11 14:27:05.632250 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-b8029381-ead3-4018-9b89-76a7ae7deb11 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=46c60fd1-4f35-496c-adf1-1f850a03f8d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271173 Nov 11 14:27:05.726871 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-09a5e525-e458-41f2-81c6-8ca1d4a20db1 service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875912 Nov 11 14:27:05.818308 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6e50543-53ce-4c13-ae96-87a165c2c8f0 req-1500b9f9-5b0b-4061-9161-4cf195f404db service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836885 Nov 11 14:27:06.036322 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3684aa43-4e10-499f-8cc1-4d592ea78bf5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:06.399033 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc5e0f2-7ac2-4064-b997-7089244bc7c0 req-acbedf0d-7787-4070-8eaa-37390678e015 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:06.400839 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1dc5e0f2-7ac2-4064-b997-7089244bc7c0 req-acbedf0d-7787-4070-8eaa-37390678e015 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0528791 Nov 11 14:27:06.409563 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bbb414f-2c16-47a9-a52d-539646a95b06 req-91b62210-f5fc-4c64-b6b0-5fb0d6ac03d4 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:06.411068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2bbb414f-2c16-47a9-a52d-539646a95b06 req-91b62210-f5fc-4c64-b6b0-5fb0d6ac03d4 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 944 time: 0.0504146 Nov 11 14:27:06.450305 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1dc5e0f2-7ac2-4064-b997-7089244bc7c0 req-f15007f4-b889-4f47-8d4c-beff9fd75e97 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436141 Nov 11 14:27:06.463940 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2bbb414f-2c16-47a9-a52d-539646a95b06 req-80a7fb64-d480-45d8-8daa-a3046da14880 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468976 Nov 11 14:27:07.354959 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:27:07.569645 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52a10c1-9ddf-4e99-a9ff-ecf886ee7f05 req-ba09c93c-1bae-4ea1-bd34-b9a3931506a2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:07.571648 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a52a10c1-9ddf-4e99-a9ff-ecf886ee7f05 req-ba09c93c-1bae-4ea1-bd34-b9a3931506a2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0475106 Nov 11 14:27:07.622118 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a52a10c1-9ddf-4e99-a9ff-ecf886ee7f05 req-2639b7a8-1c50-422d-a48c-ca184ba48d08 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445971 Nov 11 14:27:07.726258 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87a97dc-397d-4540-9f22-ba801aff128e req-7c503b08-89af-448c-8703-7734d3f17cb1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:07.727659 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c87a97dc-397d-4540-9f22-ba801aff128e req-7c503b08-89af-448c-8703-7734d3f17cb1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 944 time: 0.0484858 Nov 11 14:27:07.775442 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c87a97dc-397d-4540-9f22-ba801aff128e req-9b89c727-ea12-4818-831b-ea52abea3df1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419788 Nov 11 14:27:08.302170 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 6f453929-a95f-4aeb-83e9-5b8a818d9859 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:27:08.405774 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:08.420371 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '6f453929-a95f-4aeb-83e9-5b8a818d9859', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'port_id': '6f453929-a95f-4aeb-83e9-5b8a818d9859', 'mac_address': 'fa:16:3e:e8:47:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8112b7d5-8b09-4390-bcfa-982686a4a63b', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:27:08.455654 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:08.468529 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f453929-a95f-4aeb-83e9-5b8a818d9859 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:08.487712 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:08.527585 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1f7ada13-29f0-4bc4-8f73-8040f36d6eb9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:08.590548 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:08.636374 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:08.643399 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.643772 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.644118 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.644448 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.644779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.645104 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.645428 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.645768 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.646081 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.646404 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.646720 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.647034 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:08.739060 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c5b84c-3a1c-438d-ba8d-41305c876725 req-1e740db6-5841-4ea3-9b12-45a97d3d5fda tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:08.740539 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c6c5b84c-3a1c-438d-ba8d-41305c876725 req-1e740db6-5841-4ea3-9b12-45a97d3d5fda tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0478261 Nov 11 14:27:08.786733 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c6c5b84c-3a1c-438d-ba8d-41305c876725 req-02071951-d9c6-4cbb-80b8-14134b7ac314 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404866 Nov 11 14:27:08.890394 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10376c5d-fe29-400d-8644-cbbaff7aae32 req-3a497a11-3cdd-47b1-ab99-8a09b9512c34 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:08.891949 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-10376c5d-fe29-400d-8644-cbbaff7aae32 req-3a497a11-3cdd-47b1-ab99-8a09b9512c34 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 945 time: 0.0484807 Nov 11 14:27:08.910094 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:08.961427 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-10376c5d-fe29-400d-8644-cbbaff7aae32 req-80453242-47a0-4795-b3ef-aa5bfbb8f785 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631361 Nov 11 14:27:09.607330 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:09.907503 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cb9950-7934-4f81-99b1-2cd96b65ee81 req-956ff3bd-d979-4e71-973f-d9384e7869b0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:09.908887 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-39cb9950-7934-4f81-99b1-2cd96b65ee81 req-956ff3bd-d979-4e71-973f-d9384e7869b0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0523617 Nov 11 14:27:09.960271 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-39cb9950-7934-4f81-99b1-2cd96b65ee81 req-36d227fc-8752-48bc-a888-d7d574237156 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451713 Nov 11 14:27:10.089028 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8875aa-b453-4ca9-bb61-b599d0e7ab3c req-4006de33-5fef-4977-be24-f7d61abe11b1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:10.090638 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9b8875aa-b453-4ca9-bb61-b599d0e7ab3c req-4006de33-5fef-4977-be24-f7d61abe11b1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 945 time: 0.0568345 Nov 11 14:27:10.150455 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9b8875aa-b453-4ca9-bb61-b599d0e7ab3c req-24c63b99-e57a-4fda-a03e-eba4a9152b69 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466430 Nov 11 14:27:10.321851 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:27:10.324987 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 6f453929-a95f-4aeb-83e9-5b8a818d9859 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:27:10.456301 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:10.468000 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4c18064d-696c-4c89-af13-19525b371b78', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:27:10.503704 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.512482 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 6f453929-a95f-4aeb-83e9-5b8a818d9859 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:27:10.518487 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 6f453929-a95f-4aeb-83e9-5b8a818d9859 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:27:10.518837 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.522155 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:10.568874 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:10.613104 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.631575 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.639459 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:10.642356 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1442d0a-1b0b-4c54-81ef-6027d5a24d74" -d '{"events": [{"server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "name": "network-vif-plugged", "status": "completed", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:10.681225 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:10.687689 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-834eaa8e-8495-4faa-a654-efb902bce564 x-openstack-request-id: req-834eaa8e-8495-4faa-a654-efb902bce564 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:10.687964 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "name": "network-vif-plugged", "status": "completed", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:10.688202 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-834eaa8e-8495-4faa-a654-efb902bce564 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:10.688612 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859', 'code': 200} Nov 11 14:27:10.719710 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=6']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:10.727770 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.757740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:10.779605 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:10.829574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4c18064d-696c-4c89-af13-19525b371b78'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:10.985880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb654b8a-322a-497e-8b7d-59d75cb71f28 req-4176e3ae-b265-4b99-af34-647740443cbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:10.987987 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb654b8a-322a-497e-8b7d-59d75cb71f28 req-4176e3ae-b265-4b99-af34-647740443cbf service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 1099 time: 0.0401413 Nov 11 14:27:11.044769 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb654b8a-322a-497e-8b7d-59d75cb71f28 req-22ee40b0-60a7-4c94-86f0-7c0e0dc78299 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465567 Nov 11 14:27:11.087349 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7e403a-9a78-403e-a90f-1c62cf53e424 req-782d1e3c-a8f3-4b74-a062-a077bf170920 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:11.088839 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1b7e403a-9a78-403e-a90f-1c62cf53e424 req-782d1e3c-a8f3-4b74-a062-a077bf170920 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.0497689 Nov 11 14:27:11.138743 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1b7e403a-9a78-403e-a90f-1c62cf53e424 req-2e1528f8-fb4c-4c6e-aa6c-81ebc8c3c15a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436625 Nov 11 14:27:11.226752 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1173f2c1-8699-4a4d-964b-e85fb05fc431 req-034453ec-c922-4294-9e7f-e53d1e51ec78 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:11.228989 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1173f2c1-8699-4a4d-964b-e85fb05fc431 req-034453ec-c922-4294-9e7f-e53d1e51ec78 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0561419 Nov 11 14:27:11.278220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b13bf-b243-479c-9d64-f4402587654a req-0d28e91a-cf42-475b-b739-d5663d1aeb58 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:11.279862 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f07b13bf-b243-479c-9d64-f4402587654a req-0d28e91a-cf42-475b-b739-d5663d1aeb58 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.0523906 Nov 11 14:27:11.280662 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1173f2c1-8699-4a4d-964b-e85fb05fc431 req-3cc3bb04-3403-4d06-ab78-e1190ffa4a23 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455484 Nov 11 14:27:11.304683 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35478) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:11.335316 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f07b13bf-b243-479c-9d64-f4402587654a req-e169d9ed-4157-40fe-b508-499a9db0e745 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483444 Nov 11 14:27:11.450221 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbf1c544-5d79-40e0-b192-247c4d9f00e8 tempest-TestMinimumBasicScenario-1897771650 tempest-TestMinimumBasicScenario-1897771650-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:11.452038 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-dbf1c544-5d79-40e0-b192-247c4d9f00e8 tempest-TestMinimumBasicScenario-1897771650 tempest-TestMinimumBasicScenario-1897771650-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1093 time: 0.1454904 Nov 11 14:27:11.454656 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35482) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:11.458860 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'port_id': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:11.705032 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for floatingip, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:11.729049 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:11.810653 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:11.917865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Allocated IP 172.27.1.69 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/cf2c1bf8-28ff-4b5f-8a94-885d5a64e255) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:27:12.033011 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.042531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.139769 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.193403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:27:12.193403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:27:12.193403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:27:12.197148 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'Port': ['ID=cf2c1bf8-28ff-4b5f-8a94-885d5a64e255,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:12.309904 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b0095e-ae7a-4dfd-bd8c-a9d4f7e3cabe req-ffc3fe90-0b4d-4e8d-9963-36d5c35949aa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:12.311524 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c3b0095e-ae7a-4dfd-bd8c-a9d4f7e3cabe req-ffc3fe90-0b4d-4e8d-9963-36d5c35949aa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.0894721 Nov 11 14:27:12.331801 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:27:12.394993 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4c18064d-696c-4c89-af13-19525b371b78 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:27:12.395907 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.447579 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c3b0095e-ae7a-4dfd-bd8c-a9d4f7e3cabe req-b7726237-ac1f-4635-99a4-73671fb4d717 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1204247 Nov 11 14:27:12.525448 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.591413 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:12.654741 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:12.724378 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:12.729071 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc02f990-4b7d-4bc8-b825-4d6cf528083a" -d '{"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:12.798087 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=7']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:12.828420 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d567e4-2a93-46a0-a3bf-88d71846ed50 req-20b2ea7b-fd74-4730-8365-9e0298beeada tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:12.831887 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d8d567e4-2a93-46a0-a3bf-88d71846ed50 req-20b2ea7b-fd74-4730-8365-9e0298beeada tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.0746317 Nov 11 14:27:12.899191 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d8d567e4-2a93-46a0-a3bf-88d71846ed50 req-b2a7bad5-fdae-4cb1-9c99-1e9162cf29b0 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557175 Nov 11 14:27:12.936160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0e7e1eb-ee7a-4190-99da-cfd0995451ae x-openstack-request-id: req-d0e7e1eb-ee7a-4190-99da-cfd0995451ae {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:12.936453 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:12.936703 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-d0e7e1eb-ee7a-4190-99da-cfd0995451ae {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:12.937090 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'code': 200} Nov 11 14:27:13.090067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fdc23f1-fe4f-405c-a3d8-98b86b894dca req-30c5e90b-4181-4d5d-a35b-79a045e81409 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:13.098003 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2fdc23f1-fe4f-405c-a3d8-98b86b894dca req-30c5e90b-4181-4d5d-a35b-79a045e81409 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.4834495 Nov 11 14:27:13.175121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:13.273535 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2fdc23f1-fe4f-405c-a3d8-98b86b894dca req-656d0fd7-18b3-4ea9-bba0-d44e51ad892b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1695235 Nov 11 14:27:13.356845 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:13.531036 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:13.567753 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:13.595040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6eb503-4d3d-40d4-8e6d-50a05921cd6a req-0f184887-c1d3-4b0e-8fca-bf768f95b482 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:13.596712 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3a6eb503-4d3d-40d4-8e6d-50a05921cd6a req-0f184887-c1d3-4b0e-8fca-bf768f95b482 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0627329 Nov 11 14:27:13.641349 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'Port': ['ID=cf2c1bf8-28ff-4b5f-8a94-885d5a64e255,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:13.666426 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3a6eb503-4d3d-40d4-8e6d-50a05921cd6a req-cf1224af-5979-4871-b31d-7c9c2ed2e3c5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582247 Nov 11 14:27:13.673500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:13.776907 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Floating IP 8d72b67a-a52a-4baa-af67-c20f5a66879a associated. External IP: 172.27.1.69, port: c53a8d64-6f5c-4000-90d7-691eb1341d9a. Nov 11 14:27:14.064446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f53a745-67b6-4fea-abad-84aac9ea8f37 req-17c31f72-9e19-429d-8636-807232f49b7a tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:14.065945 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7f53a745-67b6-4fea-abad-84aac9ea8f37 req-17c31f72-9e19-429d-8636-807232f49b7a tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.0820627 Nov 11 14:27:14.073995 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Router fb1030fc-a673-40f8-8acc-5812ce724bec has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:27:14.177107 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7f53a745-67b6-4fea-abad-84aac9ea8f37 req-8cd10f08-ec77-47be-b165-f040ac67485f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018300 Nov 11 14:27:14.244425 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:27:14.259268 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Sync routers for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:27:14.270436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:27:14.273659 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:27:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:27:14.341412 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:14.411031 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d21badf3-ce04-453b-8300-6061c280700f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.9553304 Nov 11 14:27:14.411637 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:14.413882 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66ff44ad-4169-4a4a-bf96-b47ec192c385" -d '{"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:14.414104 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35526) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:14.420323 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-43880818', 'description': 'tempest-secgroup-smoke-43880818 description', 'project_id': '43dc465eb95943ee921d1e983a7e0320'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:14.456622 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63712a1d-e236-40a3-a2a3-99d2252b7588 req-9d205624-7db0-4c08-9f9f-fffd090a6ac8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:14.458367 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:27:14.464989 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63712a1d-e236-40a3-a2a3-99d2252b7588 req-9d205624-7db0-4c08-9f9f-fffd090a6ac8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.0997989 Nov 11 14:27:14.472261 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24a25ae8-1c2c-4fde-b3f3-995c63815d24 x-openstack-request-id: req-24a25ae8-1c2c-4fde-b3f3-995c63815d24 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:14.472536 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:14.472788 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-24a25ae8-1c2c-4fde-b3f3-995c63815d24 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:14.473232 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:27:14.533935 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:14.572330 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63712a1d-e236-40a3-a2a3-99d2252b7588 req-395345e1-707f-47b6-8baa-8da5cc638194 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063240 Nov 11 14:27:14.596941 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-3ef1a9e5-2041-4b6d-ac6d-2cac23431355 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:14.598463 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-3ef1a9e5-2041-4b6d-ac6d-2cac23431355 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1098 time: 0.0832169 Nov 11 14:27:14.614884 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-62ca3922-4b55-4dd9-b2cf-164db367bd30 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:14.614884 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-62ca3922-4b55-4dd9-b2cf-164db367bd30 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.0938544 Nov 11 14:27:14.732377 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-a368e061-05c2-425d-87fb-8978528ad59b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:14.734076 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-a368e061-05c2-425d-87fb-8978528ad59b service neutron] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 915 time: 0.1280551 Nov 11 14:27:14.821857 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:14.832696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Deleting port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:27:14.833002 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:14.878490 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-ab131bb1-8dbb-401f-bb91-e33fa73d96bc service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 998 time: 0.1347368 Nov 11 14:27:14.922119 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:14.966943 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a82016f9-d4d9-4029-9b9a-5e4865705f55,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:15.029254 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-106de412-b99e-40ac-9420-d77b06f47a87 req-7401518f-55c3-4211-876e-e8785ffe5a45 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:15.040530 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-106de412-b99e-40ac-9420-d77b06f47a87 req-7401518f-55c3-4211-876e-e8785ffe5a45 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.1604233 Nov 11 14:27:15.068606 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-90d3884d-d026-4664-87b5-c1e86a69ee79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:15.069040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] For port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:15.069416 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.071160 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-90d3884d-d026-4664-87b5-c1e86a69ee79 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.1797621 Nov 11 14:27:15.123976 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Calling delete_port for 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:27:15.190624 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-106de412-b99e-40ac-9420-d77b06f47a87 req-70b33243-1e99-4218-b4a3-40d60ceb10d5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1487327 Nov 11 14:27:15.219471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-e9c23a2c-4eea-4755-907b-8244e5dc1c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:15.223757 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-e9c23a2c-4eea-4755-907b-8244e5dc1c8a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1431112 Nov 11 14:27:15.262009 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '8d72b67a-a52a-4baa-af67-c20f5a66879a', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'floating_ip_address': '172.27.1.69', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'port_id': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 488, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'mac_address': 'fa:16:3e:f3:ce:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:27:12Z', 'updated_at': '2021-11-11T14:27:12Z', 'revision_number': 0, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:27:15.290137 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Checking router: fb1030fc-a673-40f8-8acc-5812ce724bec for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:27:15.299592 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:27:15.300622 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:27:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:27:15.371464 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-5adfcc53-a813-4833-83c5-1bcb385ee72a service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1388140 Nov 11 14:27:15.423578 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.432000 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:27:15.434268 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e8a6f4e8-edea-427c-ab37-9a66303eab9a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1807 time: 1.0173781 Nov 11 14:27:15.434426 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35538) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:15.447177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:15.522751 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-66ff44ad-4169-4a4a-bf96-b47ec192c385 req-95871ff7-e24d-4bd0-8162-6bba1716c7f5 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429358 Nov 11 14:27:15.542548 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a891179-56ba-4825-9039-c2af785e069a req-c5679c5c-377b-4dfe-9cdb-3c2756fc4e6f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:15.544915 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5a891179-56ba-4825-9039-c2af785e069a req-c5679c5c-377b-4dfe-9cdb-3c2756fc4e6f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 945 time: 0.2605820 Nov 11 14:27:15.593040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.611994 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:15.634283 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Pushing event deleted for resources: {'Port': ['ID=9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:15.643906 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5a891179-56ba-4825-9039-c2af785e069a req-461081b8-05d3-4e0a-83df-d442e9fd8875 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0906613 Nov 11 14:27:15.746468 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] No DVR routers for this DVR port 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:27:15.760572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.766439 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-44495e18-bfc0-4dff-b9cb-96f9b01fbbeb req-116afdfe-e7ad-47a6-a8e0-423d1e77cafc tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "DELETE /v2.0/ports/9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 HTTP/1.1" status: 204 len: 173 time: 1.1447816 Nov 11 14:27:15.767628 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'name': 'network-vif-deleted', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:15.778033 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-167462e0-2d31-46b6-a11a-1da039a8f971" -d '{"events": [{"server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "name": "network-vif-deleted", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:15.786684 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.845563 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '8d72b67a-a52a-4baa-af67-c20f5a66879a', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'floating_ip_address': '172.27.1.69', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'port_id': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 488, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'mac_address': 'fa:16:3e:f3:ce:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:27:12Z', 'updated_at': '2021-11-11T14:27:12Z', 'revision_number': 0, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:27:15.869374 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:15.871173 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2af28bd1-bf3e-4815-a038-e474454ea660 x-openstack-request-id: req-2af28bd1-bf3e-4815-a038-e474454ea660 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:15.871631 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8", "name": "network-vif-deleted", "tag": "9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:15.876340 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-2af28bd1-bf3e-4815-a038-e474454ea660 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:15.876340 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8', 'name': 'network-vif-deleted', 'tag': '9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0', 'status': 'completed', 'code': 200} Nov 11 14:27:15.879642 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10fbedf5-cb79-4a3f-b848-e7b92babef67 None None] The sync data for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi is: [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '8d72b67a-a52a-4baa-af67-c20f5a66879a', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'floating_ip_address': '172.27.1.69', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'port_id': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 488, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'mac_address': 'fa:16:3e:f3:ce:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:27:12Z', 'updated_at': '2021-11-11T14:27:12Z', 'revision_number': 0, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:27:15.977687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.003601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7cc56d7b-8d1e-4db0-98d8-abd48c534294,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:16.080708 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.083512 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35546) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:16.088653 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:16.089545 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-99786e42-b48b-478a-afe5-7477a521962a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6510746 Nov 11 14:27:16.184466 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f2e5509-0303-4e88-916e-32ab5ed9eebb None None] New status for floating IP 8d72b67a-a52a-4baa-af67-c20f5a66879a: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:27:16.313948 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0799d34a-9c56-4885-b440-1e38fe1016f0 req-a37cff52-95bd-4f89-91b0-9182daab9772 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:16.315376 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0799d34a-9c56-4885-b440-1e38fe1016f0 req-a37cff52-95bd-4f89-91b0-9182daab9772 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0532124 Nov 11 14:27:16.362509 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0799d34a-9c56-4885-b440-1e38fe1016f0 req-222525df-c086-4312-98c0-979831dc2460 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406263 Nov 11 14:27:16.394487 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.477807 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.585129 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.603650 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5348b7fc-146c-4889-a969-4327e7bdaf98,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:16.672681 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.674110 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-813aad14-4782-4962-866c-a55126189a3d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5894301 Nov 11 14:27:16.676934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35554) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:16.682377 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:16.795232 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6cf1bd90-04d2-4199-ade3-cf1366fd1402 req-5aff8525-7427-4b92-aa60-2b2359e4284c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=9dcabf6a-18d6-4f2e-8f3e-80f13f4a5ef8 HTTP/1.1" status: 200 len: 210 time: 0.0347097 Nov 11 14:27:16.825951 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.885552 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.963450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:16.986985 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=56e027ad-5afb-4bde-9eaa-5a94347738c0,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:17.068734 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.070009 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-48dd251e-0803-4981-9f2c-7cc8b7468091 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3920460 Nov 11 14:27:17.073397 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35564) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:17.077973 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:17.208457 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.284891 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.361525 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.381640 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9da2483c-68a7-4875-b3f3-7c662ab5627e,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:17.499947 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.505806 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d4653fc1-aeef-496c-9b9f-f4c4df7f10c4 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4312987 Nov 11 14:27:17.506002 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35572) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:17.512160 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:17.561044 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b2d322-4197-4f8e-86de-7123a1cff2c5 req-2c8b96f1-da78-4a97-bcec-4130a056812b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:17.562602 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-06b2d322-4197-4f8e-86de-7123a1cff2c5 req-2c8b96f1-da78-4a97-bcec-4130a056812b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0769250 Nov 11 14:27:17.642055 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.securitygroups_db [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Project 43dc465eb95943ee921d1e983a7e0320 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:27:17.642623 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-06b2d322-4197-4f8e-86de-7123a1cff2c5 req-91792f21-b952-493c-8226-4f5a21ae109c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735106 Nov 11 14:27:17.654256 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.733264 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.807988 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.869982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f6e1cde5-4408-4991-aca3-175994d43d9a,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:17.931641 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:17.937343 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-41b5a50e-a31d-4277-9a39-400102a69c77 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4258907 Nov 11 14:27:17.937674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 35578) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:17.943825 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'security_group_rule': {'security_group_id': 'a82016f9-d4d9-4029-9b9a-5e4865705f55', 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:18.082857 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.securitygroups_db [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Project 43dc465eb95943ee921d1e983a7e0320 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:27:18.090272 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:18.177039 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:18.298833 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:18.318030 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8d469d90-43ae-4839-b549-7b94ef4cc082,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:18.352970 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:27:18.382979 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:27:18.383945 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 9800f1bd-de58-4ce8-bd6f-3db6caf8f5b0 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:27:18.417368 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:18.420423 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-bd58c37b-c15a-47a4-be42-6b9c3655ce10 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4804754 Nov 11 14:27:18.547762 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-4e683ef5-40d2-44a2-afc1-e5b0fe903bb7 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-43880818&fields=id&tenant_id=43dc465eb95943ee921d1e983a7e0320 HTTP/1.1" status: 200 len: 267 time: 0.0616202 Nov 11 14:27:18.614904 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-6c53b940-04fb-41d3-bdfd-650b0b06d3fc tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:18.616843 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-6c53b940-04fb-41d3-bdfd-650b0b06d3fc tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0579057 Nov 11 14:27:18.633769 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'port': {'security_groups': ['ca12ff19-a5ee-463e-88da-8321437b44a1', 'a82016f9-d4d9-4029-9b9a-5e4865705f55']}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:18.716475 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:18.807836 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04722665-e85d-4617-9b5f-4206b77881a9 req-beeaf968-f824-40da-90a0-01dc48e600a9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:18.809347 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-04722665-e85d-4617-9b5f-4206b77881a9 req-beeaf968-f824-40da-90a0-01dc48e600a9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0692589 Nov 11 14:27:18.868942 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-04722665-e85d-4617-9b5f-4206b77881a9 req-887f98f2-731a-4b8b-a085-55550a80f49d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531743 Nov 11 14:27:18.943440 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:18.981144 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:19.043889 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:19.088115 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:19.088734 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:19.090139 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ec08742b-d087-42b9-9361-5f4dd3e79756 req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "PUT /v2.0/ports/c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 981 time: 0.4618638 Nov 11 14:27:19.090598 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:19.092986 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b33f6c7-6d49-411a-a742-705dde3c4659" -d '{"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:19.122367 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cff8511-2d84-4d6b-b2ea-532f31fd3ef8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=6']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:19.161692 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e89dafe2-dd03-4b94-ac76-ab727a6c3b2d x-openstack-request-id: req-e89dafe2-dd03-4b94-ac76-ab727a6c3b2d {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:19.161982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:19.162231 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-e89dafe2-dd03-4b94-ac76-ab727a6c3b2d {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:19.162630 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:27:19.254991 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca4ddf-5fb7-49a9-8556-b4340d1e480b req-12576353-923d-426d-bb17-85b44da6e5bb tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:19.256537 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7bca4ddf-5fb7-49a9-8556-b4340d1e480b req-12576353-923d-426d-bb17-85b44da6e5bb tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0681336 Nov 11 14:27:19.339770 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7bca4ddf-5fb7-49a9-8556-b4340d1e480b req-a3b8a219-c661-4d7a-ad89-9e666d5d63c6 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0755048 Nov 11 14:27:19.386903 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-37324a91-9f46-43f2-8865-1d05c7ed50e2 None None] Provisioning complete for port c53a8d64-6f5c-4000-90d7-691eb1341d9a triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:27:19.387491 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-37324a91-9f46-43f2-8865-1d05c7ed50e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:19.990806 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cdca03-619f-4b25-9d47-e4f1109555d0 req-dadcdb3f-1d61-407c-9b2a-da60eb311a31 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:19.992894 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4cdca03-619f-4b25-9d47-e4f1109555d0 req-dadcdb3f-1d61-407c-9b2a-da60eb311a31 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0481720 Nov 11 14:27:20.046339 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4cdca03-619f-4b25-9d47-e4f1109555d0 req-de3dc79d-3013-4df2-92b7-218a687f869c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472956 Nov 11 14:27:21.209739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec4bf21-8af1-4721-8c1d-237730e9b707 req-22c162ac-3b1a-4834-ae9d-608e95695ac2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:21.211849 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6ec4bf21-8af1-4721-8c1d-237730e9b707 req-22c162ac-3b1a-4834-ae9d-608e95695ac2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0570595 Nov 11 14:27:21.260624 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6ec4bf21-8af1-4721-8c1d-237730e9b707 req-644972ee-c38b-40a4-ad48-b08deb31efe6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427470 Nov 11 14:27:21.781632 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:21.884993 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-c8917a3e-1f31-4247-93ee-1b4d8635cbc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:21.887394 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-c8917a3e-1f31-4247-93ee-1b4d8635cbc3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1137 time: 0.0631731 Nov 11 14:27:21.927471 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:22.013534 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-d6a5d5f3-3439-402d-84f3-82f66d02a0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:22.015017 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-d6a5d5f3-3439-402d-84f3-82f66d02a0c9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 915 time: 0.1143684 Nov 11 14:27:22.113875 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-e317aa3e-8293-423d-8919-24a0a1229bf4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 1000 time: 0.0870168 Nov 11 14:27:22.222867 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-df9fcacb-f9d3-43cb-82ce-37d5a677314c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:22.225168 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-df9fcacb-f9d3-43cb-82ce-37d5a677314c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.1007631 Nov 11 14:27:22.302598 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-b8d876f2-3008-4c73-be00-3bdbcdc4ff75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:22.308602 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-b8d876f2-3008-4c73-be00-3bdbcdc4ff75 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0757353 Nov 11 14:27:22.420785 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-217959c7-ab2d-41cc-8665-64adc6817c32 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1021290 Nov 11 14:27:22.427670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172931f6-438c-4e51-a179-5b84ad3125f3 req-de351273-0cc7-4e72-8892-fb8744b0a915 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:22.429259 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-172931f6-438c-4e51-a179-5b84ad3125f3 req-de351273-0cc7-4e72-8892-fb8744b0a915 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0645199 Nov 11 14:27:22.479588 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-172931f6-438c-4e51-a179-5b84ad3125f3 req-ef1919af-f7bf-463d-aadd-27fa7128a43c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439308 Nov 11 14:27:22.542181 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4b33f6c7-6d49-411a-a742-705dde3c4659 req-66dbd151-df38-417a-a179-6a19089305fd service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1139476 Nov 11 14:27:23.605349 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965fb466-9413-40d6-91c9-151cdf8957a8 req-355234ba-afeb-4fb0-a893-cd93bc0731fd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:23.606798 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-965fb466-9413-40d6-91c9-151cdf8957a8 req-355234ba-afeb-4fb0-a893-cd93bc0731fd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0481567 Nov 11 14:27:23.655734 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-965fb466-9413-40d6-91c9-151cdf8957a8 req-58fcd429-c7d0-4e64-b726-7b9169c44f1c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431423 Nov 11 14:27:24.777674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81fe5fe2-e0b6-46af-8417-be8c49769f12 req-134cbf8f-f729-442a-b7d5-fe8745060d1e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:24.779200 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-81fe5fe2-e0b6-46af-8417-be8c49769f12 req-134cbf8f-f729-442a-b7d5-fe8745060d1e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0531566 Nov 11 14:27:24.827117 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-81fe5fe2-e0b6-46af-8417-be8c49769f12 req-905b4382-8395-4469-8102-26f01df19f86 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413594 Nov 11 14:27:25.947224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95140c77-51e0-4b9a-b599-9338f72ec414 req-241e0a8f-276c-4b48-9ca5-7be7d5463533 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:25.948637 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-95140c77-51e0-4b9a-b599-9338f72ec414 req-241e0a8f-276c-4b48-9ca5-7be7d5463533 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0481496 Nov 11 14:27:25.994207 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-95140c77-51e0-4b9a-b599-9338f72ec414 req-f76ef16b-a127-40f0-ae1e-19036aa6e637 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398266 Nov 11 14:27:27.112856 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635346c0-2eb7-44dd-b20f-54c0740e5fe5 req-80edbac6-26cd-4600-a342-0634cc79a940 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:27.114302 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-635346c0-2eb7-44dd-b20f-54c0740e5fe5 req-80edbac6-26cd-4600-a342-0634cc79a940 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 945 time: 0.0499051 Nov 11 14:27:27.161038 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-635346c0-2eb7-44dd-b20f-54c0740e5fe5 req-d25e3e14-12cc-483a-8a28-a37383a38753 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402856 Nov 11 14:27:27.956429 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:27:28.034193 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:28.061095 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:28.063405 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ade7efeb-1f55-42da-ab80-967024bd4477" -d '{"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-unplugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:28.076580 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:28.107002 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a587417-e98f-4638-8713-404f42f94dd2 x-openstack-request-id: req-0a587417-e98f-4638-8713-404f42f94dd2 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:28.107314 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-unplugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:28.107594 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-0a587417-e98f-4638-8713-404f42f94dd2 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:28.107981 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'code': 200} Nov 11 14:27:28.172559 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:28.220823 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=8']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:28.272417 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-9e95836d-7c65-4848-86f8-27e8153b955c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.274217 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-9e95836d-7c65-4848-86f8-27e8153b955c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1096 time: 0.0408337 Nov 11 14:27:28.282807 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd575ea5-799d-4e98-b078-60cc2f00205e req-4b33f73f-51e8-4ba3-a150-69a8412d4b7d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.284493 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd575ea5-799d-4e98-b078-60cc2f00205e req-4b33f73f-51e8-4ba3-a150-69a8412d4b7d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0508096 Nov 11 14:27:28.335752 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd575ea5-799d-4e98-b078-60cc2f00205e req-20320000-164a-4f80-94d0-aca1111e87f5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448008 Nov 11 14:27:28.376049 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-f61b294d-d5a3-4df2-807a-d755e36686ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.377512 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-f61b294d-d5a3-4df2-807a-d755e36686ca service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0899265 Nov 11 14:27:28.445697 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-428f3c95-9bf5-4bc5-a2e2-eda08cc3b631 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 999 time: 0.0575669 Nov 11 14:27:28.499213 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-6651658d-00db-402c-b6fb-4b4421d082cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.500686 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-6651658d-00db-402c-b6fb-4b4421d082cc service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0476117 Nov 11 14:27:28.548223 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-a4a89ace-e817-4fcf-9cc4-574e305ac7c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.549656 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-a4a89ace-e817-4fcf-9cc4-574e305ac7c2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401840 Nov 11 14:27:28.640134 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-110e2735-8ab2-4d54-9a37-655c9ad5e941 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824802 Nov 11 14:27:28.803761 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9dd331f-32f7-4970-b70c-dbae39bb60f7 req-d19a0b01-b8e1-49d9-9ddd-6a299512d1ef service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1558371 Nov 11 14:27:28.820513 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-733ebc05-2e3d-414b-a24b-3a4009e99277 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:28.821968 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-733ebc05-2e3d-414b-a24b-3a4009e99277 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1532171 Nov 11 14:27:28.838191 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-77b50a74-7ea9-4de0-a5e2-6eaadee53e2a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/quotas/58e5f180c3b54f9882a3b22f6f437768 HTTP/1.1" status: 200 len: 375 time: 0.0106196 Nov 11 14:27:28.898791 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-e0ea0907-5696-4868-86ac-c593bd711c40 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0542498 Nov 11 14:27:28.994401 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-869988fd-ada6-44f5-a512-335891077d47 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888944 Nov 11 14:27:29.032923 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-d854942a-1fa1-443f-9309-9dbffccddd3c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:29.034437 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-d854942a-1fa1-443f-9309-9dbffccddd3c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/networks?id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7 HTTP/1.1" status: 200 len: 814 time: 0.1032412 Nov 11 14:27:29.049646 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-67fb2de2-ebe2-4010-a8b2-6b3bbe4c1035 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/quotas/67dc223b706f43978cc8671a6462f9d5 HTTP/1.1" status: 200 len: 375 time: 0.0088184 Nov 11 14:27:29.080139 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-ddc5885e-eb39-4fc1-8d94-49272cd12f4d tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0246451 Nov 11 14:27:29.083969 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-24e91a30-cb66-4d6a-951a-1e09edfed82e service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835145 Nov 11 14:27:29.172951 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-5b879f2f-5233-470e-880e-51b2409f8c88 service neutron] 10.222.0.10 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854797 Nov 11 14:27:29.260862 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-b48ecebc-58c4-4438-b3d2-ec265ceaa160 service neutron] 10.222.0.10 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817692 Nov 11 14:27:29.326158 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe2160cf-3bb9-4590-a308-b73fad81966b req-7023b9d8-84f9-49f0-97ca-cee59fb811a9 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 210 time: 0.0266404 Nov 11 14:27:29.469078 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab43ea1-6335-48b3-a877-180380771c3f req-f10d6f69-5280-4c61-842d-14b539db6054 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:29.470561 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cab43ea1-6335-48b3-a877-180380771c3f req-f10d6f69-5280-4c61-842d-14b539db6054 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0549560 Nov 11 14:27:29.510087 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-57ac032a-c7fa-4706-a80e-48bfa4722374 req-9e1cd33e-0404-48c8-a348-d8c2f95419f8 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 210 time: 0.0259473 Nov 11 14:27:29.521028 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cab43ea1-6335-48b3-a877-180380771c3f req-8c5c6fcc-2129-47e3-9a3d-dfc2203c8dd9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444078 Nov 11 14:27:30.418784 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c90586fa-a09a-4122-abf2-d7e7efd83bd7 req-bb5322f6-a884-4644-b16c-d3dfcf0d8b16 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 210 time: 0.0256708 Nov 11 14:27:30.609036 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-38e85c72-0fcb-4866-aa87-504ca83fc9a5 req-a734e126-581d-40e6-b424-cdf0a4f0b2a6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 210 time: 0.0280747 Nov 11 14:27:30.660363 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb80c81a-4fd3-4269-a628-0b4388de0cd5 req-a7c9fe2e-7fe5-408e-9941-36dd12059b8c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:30.661838 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb80c81a-4fd3-4269-a628-0b4388de0cd5 req-a7c9fe2e-7fe5-408e-9941-36dd12059b8c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0622003 Nov 11 14:27:30.709668 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb80c81a-4fd3-4269-a628-0b4388de0cd5 req-acc52360-91a9-439e-8aba-a806818884ed tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417883 Nov 11 14:27:31.370573 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-52818558-e431-4537-8339-df531bdadb9a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:31.372117 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-52818558-e431-4537-8339-df531bdadb9a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1073680 Nov 11 14:27:31.389908 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Request body: {'port': {'device_id': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'admin_state_up': True, 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:31.701649 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c9612c87-fa65-4350-8905-8b9dd6adbdd6 req-71c787ab-c5d7-44fa-b8e3-441e11592924 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 210 time: 0.0571890 Nov 11 14:27:31.703591 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9bc2a8e3-c4fc-42e9-8287-964138b3e756 req-f844395f-b4a3-408f-9ed0-a3f6e37443ef tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 210 time: 0.0253780 Nov 11 14:27:31.838691 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8280dc99-c357-4763-bc08-876369130dc5 req-6b5a5687-65e1-4349-8254-5f8a3ad66cc1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:31.840285 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8280dc99-c357-4763-bc08-876369130dc5 req-6b5a5687-65e1-4349-8254-5f8a3ad66cc1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0532386 Nov 11 14:27:31.841428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:27:31.844742 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:31.935151 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8280dc99-c357-4763-bc08-876369130dc5 req-818eb8f0-0680-4805-8beb-66b4e62bcc9e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0880580 Nov 11 14:27:32.001858 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Allocated IP 172.20.0.14 (46c60fd1-4f35-496c-adf1-1f850a03f8d7/8112b7d5-8b09-4390-bcfa-982686a4a63b/71c0d0d0-62c4-4f55-bf50-79e7de51a062) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:27:32.124210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-ed1f73d7-2e8d-4742-84e6-9720c40e79f9 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:32.125780 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-ed1f73d7-2e8d-4742-84e6-9720c40e79f9 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "GET /v2.0/networks?id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7 HTTP/1.1" status: 200 len: 814 time: 0.1155763 Nov 11 14:27:32.140560 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Request body: {'port': {'device_id': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7', 'admin_state_up': True, 'tenant_id': '67dc223b706f43978cc8671a6462f9d5'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:32.171955 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.269924 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.281609 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:32.328250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:27:32.333842 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:27:32.338151 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:27:32.338981 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Made reservation on behalf of 67dc223b706f43978cc8671a6462f9d5 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:27:32.346120 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event updated for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:32.347236 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.394965 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:32.396260 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.508303 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-0b599b8e-00e4-4792-b43d-c566604d063c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1244221 Nov 11 14:27:32.512151 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Allocated IP 172.20.0.3 (2a4362f2-7b3c-4c53-9f46-25425c5daaf7/65ef7658-e991-4281-b272-34a0d1d881ca/e0e11b87-adf9-4797-b1df-ffbee2c9c622) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:27:32.523757 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Request body: {'port': {'device_id': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:32.578329 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.659935 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.761880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.813427 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:27:32.819560 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:27:32.822077 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:27:32.874971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:32.875599 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.880078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Pushing event updated for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:32.902832 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 71c0d0d0-62c4-4f55-bf50-79e7de51a062 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:32.915561 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9932a1a0-21fc-4dc6-b5c7-3f75cd22a2b4 req-f8293ae5-6569-4d22-a46c-1c027e3df39b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:32.917162 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9932a1a0-21fc-4dc6-b5c7-3f75cd22a2b4 req-f8293ae5-6569-4d22-a46c-1c027e3df39b tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 931 time: 0.1305366 Nov 11 14:27:32.922843 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:32.943159 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d68e4bf-976a-4100-a4a4-ca6689399e75 req-7489cf60-ddb6-4270-a573-41fad5404fe2 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:32.944656 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9d68e4bf-976a-4100-a4a4-ca6689399e75 req-7489cf60-ddb6-4270-a573-41fad5404fe2 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 932 time: 0.0655589 Nov 11 14:27:32.949226 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Transition to ACTIVE for port object 71c0d0d0-62c4-4f55-bf50-79e7de51a062 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:27:32.960518 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0c96867d-3187-47b7-bb5c-c222fc88bdde tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8238356 Nov 11 14:27:32.975716 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Request body: {'port': {'device_id': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:32.978143 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9932a1a0-21fc-4dc6-b5c7-3f75cd22a2b4 req-1ef75d7b-3cb6-4ede-8bc1-e62a48cc8e12 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541131 Nov 11 14:27:33.000783 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.019781 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9d68e4bf-976a-4100-a4a4-ca6689399e75 req-e13bd78d-5643-4e37-bb2a-9d838f3195af tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687988 Nov 11 14:27:33.036303 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-51538de9-3267-4a97-b309-47746fe80d8e req-b548dea4-abcb-4a3f-868f-94affabed9a0 service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:27:33.037285 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-51538de9-3267-4a97-b309-47746fe80d8e req-b548dea4-abcb-4a3f-868f-94affabed9a0 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051322 Nov 11 14:27:33.057642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.090414 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Pushing event updated for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:33.145510 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Attempting to bind port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:27:33.145739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Attempting to bind port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:27:33.146038 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Attempting to bind port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:33.152687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:27:33.153006 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Attempting to bind port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:33.160701 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:27:33.161031 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Checking segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:27:33.161412 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Bound using segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:27:33.161835 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Bound port: 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:27:33.162183 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.230624 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:27:33.233557 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:27:33.305763 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.341404 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.342130 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.343814 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] 10.222.0.11 "PUT /v2.0/ports/71c0d0d0-62c4-4f55-bf50-79e7de51a062 HTTP/1.1" status: 200 len: 1094 time: 0.8249393 Nov 11 14:27:33.346169 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:33.349332 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-273ed226-c018-48a6-88c2-5f49823dd71f" -d '{"events": [{"name": "network-changed", "server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:33.380933 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8127cd78-07a3-49bd-bb92-e4922810caca service neutron] Pushing event updated for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:33.404802 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a0e300a-87a8-4607-9ad2-0e823c008bf4 x-openstack-request-id: req-6a0e300a-87a8-4607-9ad2-0e823c008bf4 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:33.405156 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:33.405468 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-6a0e300a-87a8-4607-9ad2-0e823c008bf4 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:33.405918 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062', 'status': 'completed', 'code': 200} Nov 11 14:27:33.481957 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273ed226-c018-48a6-88c2-5f49823dd71f req-f8496e20-b698-46ba-8276-fb06b2a08c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.483597 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-273ed226-c018-48a6-88c2-5f49823dd71f req-f8496e20-b698-46ba-8276-fb06b2a08c7a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 1097 time: 0.0492506 Nov 11 14:27:33.576628 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e0e11b87-adf9-4797-b1df-ffbee2c9c622 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:33.586040 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.591572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273ed226-c018-48a6-88c2-5f49823dd71f req-96bbfd4a-01ac-4acd-a95a-d54a2720529a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.593075 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-273ed226-c018-48a6-88c2-5f49823dd71f req-96bbfd4a-01ac-4acd-a95a-d54a2720529a service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=58e5f180c3b54f9882a3b22f6f437768&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0971906 Nov 11 14:27:33.604986 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f69f76-146c-42b3-bfd2-f03cb67a971f req-964f62f0-47be-411f-9fa9-b3f58973178a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.606486 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d9f69f76-146c-42b3-bfd2-f03cb67a971f req-964f62f0-47be-411f-9fa9-b3f58973178a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.3097074 Nov 11 14:27:33.611626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Transition to ACTIVE for port object e0e11b87-adf9-4797-b1df-ffbee2c9c622 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:27:33.658283 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d9f69f76-146c-42b3-bfd2-f03cb67a971f req-574ffacc-47b0-42df-b2ce-51031c38229f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436795 Nov 11 14:27:33.665028 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.702602 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273ed226-c018-48a6-88c2-5f49823dd71f req-3fe13cf7-57ad-40eb-8f7a-3ab63e9b9cba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.704190 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-273ed226-c018-48a6-88c2-5f49823dd71f req-3fe13cf7-57ad-40eb-8f7a-3ab63e9b9cba service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1018853 Nov 11 14:27:33.717043 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Pushing event updated for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:33.788339 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Attempting to bind port e0e11b87-adf9-4797-b1df-ffbee2c9c622 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:27:33.789084 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Attempting to bind port e0e11b87-adf9-4797-b1df-ffbee2c9c622 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:27:33.789084 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Attempting to bind port e0e11b87-adf9-4797-b1df-ffbee2c9c622 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:33.793338 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Port e0e11b87-adf9-4797-b1df-ffbee2c9c622 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:27:33.793649 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Attempting to bind port e0e11b87-adf9-4797-b1df-ffbee2c9c622 on network 2a4362f2-7b3c-4c53-9f46-25425c5daaf7 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:33.798012 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-5a37dc3d-e026-43a0-83f6-da539a64a7e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.798489 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:27:33.798817 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Checking segment: {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:27:33.799183 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Bound using segment: {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:27:33.799527 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-5a37dc3d-e026-43a0-83f6-da539a64a7e5 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 1097 time: 0.0424726 Nov 11 14:27:33.799647 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Bound port: e0e11b87-adf9-4797-b1df-ffbee2c9c622, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ddeb9def-079c-4756-a438-c91278e6acb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 305, 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:27:33.804630 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.848156 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-a0ec08eb-0a1a-442a-96f9-bec963352114 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062 HTTP/1.1" status: 200 len: 217 time: 0.0399482 Nov 11 14:27:33.864418 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:27:33.867714 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:27:33.881586 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 35806) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:33.903261 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05ee175-2706-462a-acb9-6249e806acaa req-adca99d1-c57b-4fb6-b3af-90497a477a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:33.904780 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-adca99d1-c57b-4fb6-b3af-90497a477a89 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=8112b7d5-8b09-4390-bcfa-982686a4a63b HTTP/1.1" status: 200 len: 854 time: 0.0493131 Nov 11 14:27:33.937905 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-85511b3f-ce7f-43f1-9519-2567e584884d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=46c60fd1-4f35-496c-adf1-1f850a03f8d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251625 Nov 11 14:27:33.949483 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:33.982410 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:27:34.008808 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.009427 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:34.010832 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] 10.222.0.11 "PUT /v2.0/ports/e0e11b87-adf9-4797-b1df-ffbee2c9c622 HTTP/1.1" status: 200 len: 1093 time: 1.0405393 Nov 11 14:27:34.011289 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:34.013550 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f351add-3504-4861-8496-9db912389fe8" -d '{"events": [{"name": "network-changed", "server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:34.022291 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aef5c2a-e10c-4d13-8329-e3eeee0562d7 service neutron] Pushing event updated for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:34.028572 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-80fdd25a-586e-4829-aab7-4033c94ea876 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1452997 Nov 11 14:27:34.039284 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-f2286d2d-ffcd-48be-a1a8-54ad71f47b6e service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927606 Nov 11 14:27:34.042770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-21f32ee3-05d9-4e36-beca-dfa02157001c service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:27:34.048385 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-21f32ee3-05d9-4e36-beca-dfa02157001c service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0100720 Nov 11 14:27:34.092691 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-456605b3-0225-4abd-a315-5e11c591b22f x-openstack-request-id: req-456605b3-0225-4abd-a315-5e11c591b22f {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:34.092691 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:34.092691 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-456605b3-0225-4abd-a315-5e11c591b22f {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:34.092691 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622', 'status': 'completed', 'code': 200} Nov 11 14:27:34.152463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f351add-3504-4861-8496-9db912389fe8 req-d090d816-40dc-4456-88b3-4706100181ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.154309 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f351add-3504-4861-8496-9db912389fe8 req-d090d816-40dc-4456-88b3-4706100181ce service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 1096 time: 0.0551732 Nov 11 14:27:34.213253 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10f9ff4-57e8-4e8d-a43f-62c3b945d063 req-25109932-e336-4fc4-b281-63e45a67221f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.214593 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a10f9ff4-57e8-4e8d-a43f-62c3b945d063 req-25109932-e336-4fc4-b281-63e45a67221f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 943 time: 0.0932631 Nov 11 14:27:34.227934 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a05ee175-2706-462a-acb9-6249e806acaa req-3ccd8326-8e21-44a0-9c29-e9f95c183321 service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1801698 Nov 11 14:27:34.271544 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a10f9ff4-57e8-4e8d-a43f-62c3b945d063 req-89ad9eb4-0d41-4642-af0c-66b58e7a2c79 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468760 Nov 11 14:27:34.277341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08952e3-ae41-4ba4-a006-8e13099622b2 req-ea76b308-dd7e-4ed3-9275-1884f042430e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.278733 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a08952e3-ae41-4ba4-a006-8e13099622b2 req-ea76b308-dd7e-4ed3-9275-1884f042430e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 944 time: 0.1234121 Nov 11 14:27:34.321489 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f351add-3504-4861-8496-9db912389fe8 req-c61128d9-28f4-41c7-a4b1-4e488e72ff21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.322916 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f351add-3504-4861-8496-9db912389fe8 req-c61128d9-28f4-41c7-a4b1-4e488e72ff21 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=67dc223b706f43978cc8671a6462f9d5&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1574955 Nov 11 14:27:34.370015 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a08952e3-ae41-4ba4-a006-8e13099622b2 req-d1c57425-f8b2-47f5-9f40-a6113c67e8be tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820129 Nov 11 14:27:34.434174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f351add-3504-4861-8496-9db912389fe8 req-87d4826b-8681-4d4d-8a75-30e1415c2fd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.435697 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f351add-3504-4861-8496-9db912389fe8 req-87d4826b-8681-4d4d-8a75-30e1415c2fd2 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1053240 Nov 11 14:27:34.525201 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0b230c67-9162-4e53-a230-347e60588c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.526704 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-0b230c67-9162-4e53-a230-347e60588c3e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=67dc223b706f43978cc8671a6462f9d5&device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 1096 time: 0.0520871 Nov 11 14:27:34.576345 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-86f5df0e-81fb-4b96-8263-3672cd3abab0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622 HTTP/1.1" status: 200 len: 217 time: 0.0366254 Nov 11 14:27:34.629632 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-c92c463f-8187-4f77-b62d-5e7e54e2cff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.631018 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-c92c463f-8187-4f77-b62d-5e7e54e2cff8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=65ef7658-e991-4281-b272-34a0d1d881ca HTTP/1.1" status: 200 len: 854 time: 0.0446711 Nov 11 14:27:34.666281 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-e17c126e-8562-45ab-9b26-b8fb7b5140d7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=2a4362f2-7b3c-4c53-9f46-25425c5daaf7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262568 Nov 11 14:27:34.767926 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-1ca2be87-0c00-46c2-8d87-c87b82062afe service neutron] 10.222.0.11 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949399 Nov 11 14:27:34.792562 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d2ce4b-56da-44c3-80d8-b33b9df4d4a6 req-70eea3fc-121c-4867-bc8c-0d1002740b09 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:34.794119 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f0d2ce4b-56da-44c3-80d8-b33b9df4d4a6 req-70eea3fc-121c-4867-bc8c-0d1002740b09 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0596673 Nov 11 14:27:34.845339 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f0d2ce4b-56da-44c3-80d8-b33b9df4d4a6 req-31f0dec3-e248-4ef9-84d1-17c4e75ad31e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452151 Nov 11 14:27:34.880920 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c60c8c4e-007f-4e4a-8323-e7daa70c49a2 req-f92b3dbe-8db8-4f13-8746-79b57e48e83a service neutron] 10.222.0.11 "GET /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055367 Nov 11 14:27:35.387282 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30164020-8e4e-4bed-a5bc-378542c9759a req-7c2ada4a-77fc-4a6a-a8a1-6e900f978720 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:35.388781 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-30164020-8e4e-4bed-a5bc-378542c9759a req-7c2ada4a-77fc-4a6a-a8a1-6e900f978720 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 943 time: 0.0485408 Nov 11 14:27:35.437395 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-30164020-8e4e-4bed-a5bc-378542c9759a req-cbc2991d-ff63-4db1-88c9-ba5ba48e29fe tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424633 Nov 11 14:27:35.534114 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed6c543-31ab-4dbe-99c9-1340c9c4a903 req-3dd950c4-e267-487a-9b12-a430d02a98d9 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:35.536614 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4ed6c543-31ab-4dbe-99c9-1340c9c4a903 req-3dd950c4-e267-487a-9b12-a430d02a98d9 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 944 time: 0.0983572 Nov 11 14:27:35.583506 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4ed6c543-31ab-4dbe-99c9-1340c9c4a903 req-087c3b4c-f6ce-4714-bbe1-808a887cb44b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418453 Nov 11 14:27:35.964608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4233bb23-079d-4f61-a2a8-555792d3a1e3 req-0b792e93-df60-49ff-b14c-020b40ca3c27 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:35.966198 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4233bb23-079d-4f61-a2a8-555792d3a1e3 req-0b792e93-df60-49ff-b14c-020b40ca3c27 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0485568 Nov 11 14:27:35.996097 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 71c0d0d0-62c4-4f55-bf50-79e7de51a062 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:27:36.009604 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1d31258c-af3a-442c-99a4-83f81ce26e83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:36.016895 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4233bb23-079d-4f61-a2a8-555792d3a1e3 req-57ce3571-0f3b-44a2-acb4-d33923e65419 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447958 Nov 11 14:27:36.113307 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:36.125244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '71c0d0d0-62c4-4f55-bf50-79e7de51a062', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'port_id': '71c0d0d0-62c4-4f55-bf50-79e7de51a062', 'mac_address': 'fa:16:3e:bb:5b:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8112b7d5-8b09-4390-bcfa-982686a4a63b', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:27:36.166054 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:36.178778 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 71c0d0d0-62c4-4f55-bf50-79e7de51a062 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:36.197816 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:36.298102 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:36.298695 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device e0e11b87-adf9-4797-b1df-ffbee2c9c622 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:27:36.368829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:36.432884 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:36.443635 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622', 'network_id': '2a4362f2-7b3c-4c53-9f46-25425c5daaf7', 'port_id': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622', 'mac_address': 'fa:16:3e:ed:4c:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 305, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65ef7658-e991-4281-b272-34a0d1d881ca', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:27:36.480972 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:36.493626 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e0e11b87-adf9-4797-b1df-ffbee2c9c622 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:36.514231 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:36.556349 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d8292d-9898-442a-9631-a99e2cf196f8 req-2c018230-a448-40d9-ab80-293b1ffca92c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:36.559528 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-39d8292d-9898-442a-9631-a99e2cf196f8 req-2c018230-a448-40d9-ab80-293b1ffca92c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 943 time: 0.0547750 Nov 11 14:27:36.583577 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:36.609983 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-39d8292d-9898-442a-9631-a99e2cf196f8 req-3af8417f-2cb8-47d9-97d5-7726bfc5d85f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445762 Nov 11 14:27:36.630733 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:36.733132 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-d72dc233-300c-426b-9f1c-1de2a08333e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:36.734585 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-d72dc233-300c-426b-9f1c-1de2a08333e3 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 1096 time: 0.1026146 Nov 11 14:27:36.744896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1baf84d-4503-4235-b3fb-cdd9a628ec1b req-8e6763b2-9a97-4a3c-b611-5fe752375e3c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:36.746871 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f1baf84d-4503-4235-b3fb-cdd9a628ec1b req-8e6763b2-9a97-4a3c-b611-5fe752375e3c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 945 time: 0.0812075 Nov 11 14:27:36.825136 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-5a670d65-7391-41d2-973a-1e11b77de19e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:36.826494 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-5a670d65-7391-41d2-973a-1e11b77de19e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1096 time: 0.0664175 Nov 11 14:27:36.829751 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f1baf84d-4503-4235-b3fb-cdd9a628ec1b req-1fc62e11-31fe-4dff-83a6-02c3bf735a61 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762322 Nov 11 14:27:36.839614 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['71c0d0d0-62c4-4f55-bf50-79e7de51a062'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:36.842227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['e0e11b87-adf9-4797-b1df-ffbee2c9c622'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:36.919978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-21034fc4-eec1-40e8-ab18-9b86abd38657 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:36.921439 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-21034fc4-eec1-40e8-ab18-9b86abd38657 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0848804 Nov 11 14:27:36.990612 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-5048bc21-4dd4-461c-ac49-4591d48dbe04 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 999 time: 0.0602140 Nov 11 14:27:37.041239 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-122219d5-e8fb-437c-aad6-6961a7356727 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:37.042684 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-122219d5-e8fb-437c-aad6-6961a7356727 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0437489 Nov 11 14:27:37.089825 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-79b7514a-cdd3-40e3-9bbd-2f4878fd6952 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:37.091219 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-79b7514a-cdd3-40e3-9bbd-2f4878fd6952 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0410969 Nov 11 14:27:37.141760 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a815a523-278d-4977-bb02-531781e9aca6 req-9566b581-57a5-490d-be23-38bee836c7c5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:37.143254 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a815a523-278d-4977-bb02-531781e9aca6 req-9566b581-57a5-490d-be23-38bee836c7c5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0533106 Nov 11 14:27:37.185256 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-576fb617-cd6d-4184-8116-ff3f636e3f41 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849938 Nov 11 14:27:37.190404 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a815a523-278d-4977-bb02-531781e9aca6 req-f1f2b5c9-3832-4686-857c-fe8e8a69172c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407612 Nov 11 14:27:37.272932 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-fa8bf48f-8242-49ff-919c-1f0733a4458d service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805297 Nov 11 14:27:37.756391 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d98455-84c5-4b8b-a1a6-7730ae03323f req-04e0088b-b075-417c-aa2b-87bf5847a12d tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:37.758050 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d8d98455-84c5-4b8b-a1a6-7730ae03323f req-04e0088b-b075-417c-aa2b-87bf5847a12d tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 944 time: 0.0804713 Nov 11 14:27:37.835945 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d8d98455-84c5-4b8b-a1a6-7730ae03323f req-949ba1a0-3b60-493c-a7b4-bd226c2e7593 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712817 Nov 11 14:27:37.967357 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c642f64-5c5d-4e38-b7da-6c394efa7505 req-6aba44b6-5895-468b-ad89-c5c0c36f2d81 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:37.969047 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c642f64-5c5d-4e38-b7da-6c394efa7505 req-6aba44b6-5895-468b-ad89-c5c0c36f2d81 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 945 time: 0.0525217 Nov 11 14:27:38.004549 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device e0e11b87-adf9-4797-b1df-ffbee2c9c622 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:27:38.024552 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c642f64-5c5d-4e38-b7da-6c394efa7505 req-ff285988-18a8-44ca-a914-1a04da517b47 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496016 Nov 11 14:27:38.109565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port e0e11b87-adf9-4797-b1df-ffbee2c9c622 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:27:38.113994 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port e0e11b87-adf9-4797-b1df-ffbee2c9c622 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:27:38.114342 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.198400 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.226491 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:38.228817 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90dbae4b-4477-41b5-a5ee-2432f936ce20" -d '{"events": [{"server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "name": "network-vif-plugged", "status": "completed", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:38.243996 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:38.272163 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-239302df-c11c-4bf0-a063-f93613073b2e x-openstack-request-id: req-239302df-c11c-4bf0-a063-f93613073b2e {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:38.272480 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "name": "network-vif-plugged", "status": "completed", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:38.273380 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-239302df-c11c-4bf0-a063-f93613073b2e {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:38.273783 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622', 'code': 200} Nov 11 14:27:38.309913 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.310711 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 71c0d0d0-62c4-4f55-bf50-79e7de51a062 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:27:38.330370 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d880d8d-b67b-4f78-9102-e1c95d7773bc req-d3af60be-aa12-4614-85bb-545205febbc6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:38.332337 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d880d8d-b67b-4f78-9102-e1c95d7773bc req-d3af60be-aa12-4614-85bb-545205febbc6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0535231 Nov 11 14:27:38.384813 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d880d8d-b67b-4f78-9102-e1c95d7773bc req-fb56b3c6-38fa-436b-b59b-984f5cda521e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463707 Nov 11 14:27:38.408808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:38.458218 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fa9e9087-1199-40e2-a365-324e13c9686d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.481077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:27:38.485318 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:27:38.485675 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.690974 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.726786 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:38.784122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:38.834526 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:38.957768 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111b1990-6d95-43d9-bef6-de23dca8e379 req-f3c2a5b1-9b22-41c2-bb36-389f98279bab tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:38.959647 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-111b1990-6d95-43d9-bef6-de23dca8e379 req-f3c2a5b1-9b22-41c2-bb36-389f98279bab tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0512602 Nov 11 14:27:39.008631 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-111b1990-6d95-43d9-bef6-de23dca8e379 req-3ab6daf3-3571-4499-bf17-5b1a1546e2d7 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423925 Nov 11 14:27:39.146243 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d761e43-317a-44ac-825a-ca16535b59bf req-52c8ffef-ee57-4224-ac82-1050bf497bfe tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:39.148409 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d761e43-317a-44ac-825a-ca16535b59bf req-52c8ffef-ee57-4224-ac82-1050bf497bfe tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0546269 Nov 11 14:27:39.200688 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d761e43-317a-44ac-825a-ca16535b59bf req-e9111875-6258-44e0-9495-38b18f8a5c10 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463579 Nov 11 14:27:39.529901 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0151b0dc-5933-401c-aee2-dc5dc593fd57 req-b6bb3b5b-386a-48d9-a127-24dc2c1ce153 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:39.532047 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0151b0dc-5933-401c-aee2-dc5dc593fd57 req-b6bb3b5b-386a-48d9-a127-24dc2c1ce153 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0532792 Nov 11 14:27:39.582195 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0151b0dc-5933-401c-aee2-dc5dc593fd57 req-47694d36-c29e-47fb-bb0d-620390e53a73 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441442 Nov 11 14:27:39.595187 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:40.138606 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63506b52-fc75-4fdd-8f8f-f206a06a7de2 req-82a8d3c3-684a-4eaa-b946-2ae4777bce28 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:40.140139 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-63506b52-fc75-4fdd-8f8f-f206a06a7de2 req-82a8d3c3-684a-4eaa-b946-2ae4777bce28 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0557182 Nov 11 14:27:40.204764 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-63506b52-fc75-4fdd-8f8f-f206a06a7de2 req-3ffa0675-dc08-4cc1-869b-9fdfdda6687d tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588255 Nov 11 14:27:40.274743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:40.277083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3df48e22-854b-4893-9a1c-bb148e2c9c41" -d '{"events": [{"server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "name": "network-vif-plugged", "status": "completed", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:40.331056 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4562e760-909d-421d-b68c-92c891a11c7f x-openstack-request-id: req-4562e760-909d-421d-b68c-92c891a11c7f {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:40.331448 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "name": "network-vif-plugged", "status": "completed", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:40.331765 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4562e760-909d-421d-b68c-92c891a11c7f {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:40.332215 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062', 'code': 200} Nov 11 14:27:40.332919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ef5cd1-cfca-47e0-b679-ca54f0071c3c req-f7aa7ae0-412c-46fc-b42e-cda6ddf1fe5f tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:40.334465 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e5ef5cd1-cfca-47e0-b679-ca54f0071c3c req-f7aa7ae0-412c-46fc-b42e-cda6ddf1fe5f tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0659409 Nov 11 14:27:40.383511 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e5ef5cd1-cfca-47e0-b679-ca54f0071c3c req-923a1c13-11f4-4def-84bc-c7a8bc983b90 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417409 Nov 11 14:27:40.708313 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba84f20-9dc2-4866-9ba9-ce01ddfdd5af req-8a48244b-fd53-4a4c-884c-5a6335d182b7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:40.709933 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2ba84f20-9dc2-4866-9ba9-ce01ddfdd5af req-8a48244b-fd53-4a4c-884c-5a6335d182b7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0510597 Nov 11 14:27:40.720591 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:40.758343 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2ba84f20-9dc2-4866-9ba9-ce01ddfdd5af req-350033bd-1793-43d7-8b15-c1a3a1901229 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424066 Nov 11 14:27:41.326980 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d0d3b2-f0fd-471f-b74e-7f8874732025 req-6a88bcb9-ff08-4222-9987-04884f5e94d4 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:41.328518 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-01d0d3b2-f0fd-471f-b74e-7f8874732025 req-6a88bcb9-ff08-4222-9987-04884f5e94d4 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0497451 Nov 11 14:27:41.379948 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-01d0d3b2-f0fd-471f-b74e-7f8874732025 req-d56ae7fa-6744-4508-b721-734725163004 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424867 Nov 11 14:27:41.504362 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e210b9de-f4d9-4b7b-92af-4b69795eafc7 req-d4b2c045-81ff-411a-a9d3-389e2700acdf tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:41.505838 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e210b9de-f4d9-4b7b-92af-4b69795eafc7 req-d4b2c045-81ff-411a-a9d3-389e2700acdf tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0540562 Nov 11 14:27:41.554682 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e210b9de-f4d9-4b7b-92af-4b69795eafc7 req-17297a6e-6ebe-42bb-9470-6a3ef5efb0dc tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420470 Nov 11 14:27:41.692352 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:41.883767 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190c703e-75b4-43a7-9310-a014a96ca420 req-985de868-0201-4ef2-b818-18f2dea83908 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:41.885352 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-190c703e-75b4-43a7-9310-a014a96ca420 req-985de868-0201-4ef2-b818-18f2dea83908 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0505273 Nov 11 14:27:41.938062 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-190c703e-75b4-43a7-9310-a014a96ca420 req-0573f661-3739-45e6-9de0-1d66134ed0cc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466805 Nov 11 14:27:42.029725 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:42.263458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113b35d5-50bc-4414-982c-8fad1f6258ec req-cb854743-a4bc-43ee-9fcb-ab5697667ad3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:42.265162 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-113b35d5-50bc-4414-982c-8fad1f6258ec req-cb854743-a4bc-43ee-9fcb-ab5697667ad3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0513208 Nov 11 14:27:42.331522 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-113b35d5-50bc-4414-982c-8fad1f6258ec req-9e8ff6c5-fde7-4cc3-9fd1-76cae510bb6a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0569901 Nov 11 14:27:42.505244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccefabe-78f7-4496-b5e3-6b5654cac75a req-09333af5-6869-4558-9037-59ca26e89b2f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:42.506892 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2ccefabe-78f7-4496-b5e3-6b5654cac75a req-09333af5-6869-4558-9037-59ca26e89b2f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0509863 Nov 11 14:27:42.558101 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2ccefabe-78f7-4496-b5e3-6b5654cac75a req-4515b829-0a34-4f38-9c09-c6722369c435 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446985 Nov 11 14:27:42.679854 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cbc1cd-c2db-4471-88e7-0a7c82c8e168 req-2fd11842-0b94-4213-afff-ecda3ad40c1b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:42.681602 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e4cbc1cd-c2db-4471-88e7-0a7c82c8e168 req-2fd11842-0b94-4213-afff-ecda3ad40c1b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0591350 Nov 11 14:27:42.735799 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e4cbc1cd-c2db-4471-88e7-0a7c82c8e168 req-1120939c-662f-4708-883c-2ec5c1aa6673 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480366 Nov 11 14:27:43.065149 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c557c5c-f792-4a9d-aff6-10fd7ea7b470 req-a7f2321a-59e1-41a2-bf2f-ef5657ea456e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:43.066631 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3c557c5c-f792-4a9d-aff6-10fd7ea7b470 req-a7f2321a-59e1-41a2-bf2f-ef5657ea456e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0526059 Nov 11 14:27:43.121101 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3c557c5c-f792-4a9d-aff6-10fd7ea7b470 req-47bf25d1-a660-4e19-a88f-c8d84dbedc01 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460901 Nov 11 14:27:43.456815 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fbaaf3-438b-4e50-8887-9fc7fe0fd2a2 req-a99aa17d-a3ec-4454-88d4-493093064f7d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:43.458279 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-99fbaaf3-438b-4e50-8887-9fc7fe0fd2a2 req-a99aa17d-a3ec-4454-88d4-493093064f7d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0541804 Nov 11 14:27:43.530225 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-99fbaaf3-438b-4e50-8887-9fc7fe0fd2a2 req-bee60d37-3976-4c28-a214-465bbe1cdce2 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0652192 Nov 11 14:27:43.673528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9397430e-f6c7-4d4b-8ae2-41b3498276d0 req-28682da8-3d3a-4a42-9cc1-ab61764c1dd3 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:43.674947 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9397430e-f6c7-4d4b-8ae2-41b3498276d0 req-28682da8-3d3a-4a42-9cc1-ab61764c1dd3 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0515490 Nov 11 14:27:43.723195 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9397430e-f6c7-4d4b-8ae2-41b3498276d0 req-bdd0c65f-5f28-47ee-b55d-3e15969c765f tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418987 Nov 11 14:27:43.853901 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd200e38-7346-44ce-8ae8-165255fd0b2b req-c184e65d-11dc-4736-8218-22b5a34cad66 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:43.855409 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dd200e38-7346-44ce-8ae8-165255fd0b2b req-c184e65d-11dc-4736-8218-22b5a34cad66 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0515954 Nov 11 14:27:43.904548 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dd200e38-7346-44ce-8ae8-165255fd0b2b req-840fe1e0-10b0-4bd0-9ebb-bde78341b5f7 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433373 Nov 11 14:27:44.252817 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c892d7e-9673-412b-8dc8-70ad28b51450 req-2aa94e5e-e4bc-4922-bb58-7912146f4665 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:44.255259 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9c892d7e-9673-412b-8dc8-70ad28b51450 req-2aa94e5e-e4bc-4922-bb58-7912146f4665 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0565863 Nov 11 14:27:44.310234 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9c892d7e-9673-412b-8dc8-70ad28b51450 req-97bbe786-2819-4481-b755-de355971de46 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483890 Nov 11 14:27:44.354439 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:27:44.657016 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a5725f-04c4-4408-91ba-bdd12ced0129 req-3c4d5d3e-5339-4235-9074-97045d0719cf tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:44.660141 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-90a5725f-04c4-4408-91ba-bdd12ced0129 req-3c4d5d3e-5339-4235-9074-97045d0719cf tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0592375 Nov 11 14:27:44.721094 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-90a5725f-04c4-4408-91ba-bdd12ced0129 req-89f5af42-1f58-4104-9c55-582e60046499 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0561912 Nov 11 14:27:44.840994 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19420385-42bc-44cb-a7b0-e886604b7506 req-94d64893-3412-45e4-b43f-13b36b61c284 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:44.842393 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-19420385-42bc-44cb-a7b0-e886604b7506 req-94d64893-3412-45e4-b43f-13b36b61c284 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0510049 Nov 11 14:27:44.891210 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-19420385-42bc-44cb-a7b0-e886604b7506 req-dbd70554-3c16-4f8e-8b74-d9656bd56f77 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429838 Nov 11 14:27:45.025205 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe0c1a96-a1f6-40ac-a20e-e4ae9abb8ab5 req-43f255b7-4de2-40da-950d-27ad85e2c143 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:45.026687 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe0c1a96-a1f6-40ac-a20e-e4ae9abb8ab5 req-43f255b7-4de2-40da-950d-27ad85e2c143 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0562890 Nov 11 14:27:45.076399 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe0c1a96-a1f6-40ac-a20e-e4ae9abb8ab5 req-e950c60c-cb91-4b92-9b89-749a447ac971 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436201 Nov 11 14:27:45.433528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9a873b-8afc-46be-ac11-d6880c9953e2 req-af84d6fd-51db-4306-85f8-b6a1e3d8ab88 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:45.435234 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8b9a873b-8afc-46be-ac11-d6880c9953e2 req-af84d6fd-51db-4306-85f8-b6a1e3d8ab88 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0496385 Nov 11 14:27:45.482755 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8b9a873b-8afc-46be-ac11-d6880c9953e2 req-4585c96f-df93-4771-a7c1-d5343cc7f901 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414696 Nov 11 14:27:45.837703 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4e0ab2-7775-4cb0-aafe-b5c19b473f59 req-65f6f4ae-f662-465b-8e25-6a2cee07f714 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:45.839202 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6a4e0ab2-7775-4cb0-aafe-b5c19b473f59 req-65f6f4ae-f662-465b-8e25-6a2cee07f714 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0504699 Nov 11 14:27:45.908040 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6a4e0ab2-7775-4cb0-aafe-b5c19b473f59 req-11d6f80b-e4c6-46e8-a515-1e778ed60297 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0624673 Nov 11 14:27:46.027990 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff5e2873-2514-4188-ad9d-3903b2f8dcf0 req-3ff65eaf-0ec0-4262-b874-f235070ce376 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:46.029538 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ff5e2873-2514-4188-ad9d-3903b2f8dcf0 req-3ff65eaf-0ec0-4262-b874-f235070ce376 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0546234 Nov 11 14:27:46.078865 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ff5e2873-2514-4188-ad9d-3903b2f8dcf0 req-e43da196-e71c-4153-9826-f11ec10273a2 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434804 Nov 11 14:27:46.197984 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab69f0f-5783-4075-85e6-590747ddde8b req-1dce48dc-540a-4fe2-9830-4156e947cef1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:46.200938 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fab69f0f-5783-4075-85e6-590747ddde8b req-1dce48dc-540a-4fe2-9830-4156e947cef1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0511220 Nov 11 14:27:46.249513 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fab69f0f-5783-4075-85e6-590747ddde8b req-d982a938-0eb9-4c7d-80c8-7e2b2f160347 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440929 Nov 11 14:27:46.616067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec61e392-30cd-4cdd-a298-c46e34038ef8 req-ccf4bcd4-ecf3-434e-9e36-49b7087824f8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:46.617567 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ec61e392-30cd-4cdd-a298-c46e34038ef8 req-ccf4bcd4-ecf3-434e-9e36-49b7087824f8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0514541 Nov 11 14:27:46.667735 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ec61e392-30cd-4cdd-a298-c46e34038ef8 req-7a6eefd1-04c0-4b63-8a7d-6a91c29b471e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432432 Nov 11 14:27:47.028067 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dc9076-3693-4194-836d-e936af4898dd req-4587165d-720d-4304-8315-aba43c0ebfad tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:47.029559 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-58dc9076-3693-4194-836d-e936af4898dd req-4587165d-720d-4304-8315-aba43c0ebfad tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0504704 Nov 11 14:27:47.090914 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-58dc9076-3693-4194-836d-e936af4898dd req-752b4021-1495-4e6e-be4e-bef663075f87 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0553195 Nov 11 14:27:47.210748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e3765-af4a-47a9-97bb-34e658e06a0a req-3e8cddfb-ac3f-400c-bf0d-896920f993b0 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:47.212300 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3f5e3765-af4a-47a9-97bb-34e658e06a0a req-3e8cddfb-ac3f-400c-bf0d-896920f993b0 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0591943 Nov 11 14:27:47.264711 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3f5e3765-af4a-47a9-97bb-34e658e06a0a req-4909affb-2c7d-4faa-9c8b-35c6aa6eb223 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465500 Nov 11 14:27:47.369596 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b50682-765e-4a3b-8812-48316b69b8b1 req-e198c4ec-8626-468b-a270-99729ec726ee tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:47.371179 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-05b50682-765e-4a3b-8812-48316b69b8b1 req-e198c4ec-8626-468b-a270-99729ec726ee tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0529332 Nov 11 14:27:47.419948 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-05b50682-765e-4a3b-8812-48316b69b8b1 req-19b5491e-f965-4f42-ad50-3209abc92884 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425987 Nov 11 14:27:47.796787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279f9987-7b85-4d6f-b03a-eb03c26c084d req-5e1b8964-1451-4117-a428-5509a09826c1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:47.798612 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-279f9987-7b85-4d6f-b03a-eb03c26c084d req-5e1b8964-1451-4117-a428-5509a09826c1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0561175 Nov 11 14:27:47.849220 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-279f9987-7b85-4d6f-b03a-eb03c26c084d req-e3f13c1b-b10a-47bd-b226-913240c329a9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429180 Nov 11 14:27:48.209530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4455cb62-56a0-4ccd-99ce-bd62444a2d5a req-0f8bf2f8-7e71-4c18-8bc5-7156e52b967d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:48.211496 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4455cb62-56a0-4ccd-99ce-bd62444a2d5a req-0f8bf2f8-7e71-4c18-8bc5-7156e52b967d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0508180 Nov 11 14:27:48.288831 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4455cb62-56a0-4ccd-99ce-bd62444a2d5a req-b70b7907-c9b9-4540-9768-5262e73be5cf tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0697086 Nov 11 14:27:48.392551 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd45bdf0-3564-444c-97af-f2e7ef74986f req-761da1b2-1005-431a-bc89-4ecd5a193882 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:48.394089 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fd45bdf0-3564-444c-97af-f2e7ef74986f req-761da1b2-1005-431a-bc89-4ecd5a193882 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0493753 Nov 11 14:27:48.444099 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fd45bdf0-3564-444c-97af-f2e7ef74986f req-2ecdc2c0-1604-4856-907c-7491ef20c19e tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428941 Nov 11 14:27:48.537362 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f29ed6-63e6-45ec-8f54-4631b4e08ac5 req-b78ee341-4fb1-4c07-96d2-143fc5f2ada0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:48.539547 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a3f29ed6-63e6-45ec-8f54-4631b4e08ac5 req-b78ee341-4fb1-4c07-96d2-143fc5f2ada0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0507898 Nov 11 14:27:48.598543 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a3f29ed6-63e6-45ec-8f54-4631b4e08ac5 req-ec49a075-3dd8-485c-a315-553e2dfed43b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526600 Nov 11 14:27:48.986837 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4005dd-2920-4b99-8c26-52dbce23eeaa req-1648ca1f-915d-4147-afd1-a08fa17cd8d3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:48.988392 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7c4005dd-2920-4b99-8c26-52dbce23eeaa req-1648ca1f-915d-4147-afd1-a08fa17cd8d3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0581372 Nov 11 14:27:49.035977 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7c4005dd-2920-4b99-8c26-52dbce23eeaa req-2ae7ffb3-dfa1-41ea-98d3-ef73b3e1a4c3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416710 Nov 11 14:27:49.403178 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d181b9-a7a6-479c-956e-7cf9e2f229a5 req-ff0f934e-b4e5-4ea4-b986-92d8bd7ae78f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.404649 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-16d181b9-a7a6-479c-956e-7cf9e2f229a5 req-ff0f934e-b4e5-4ea4-b986-92d8bd7ae78f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0487430 Nov 11 14:27:49.463704 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-16d181b9-a7a6-479c-956e-7cf9e2f229a5 req-d3080ce5-1b1a-40a9-9e2f-e09855d6d76a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0531371 Nov 11 14:27:49.556014 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab096e3-efab-4d61-9b11-e069aae98e01 req-579b27c2-7ad8-4a58-a28e-8ad747f2837c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.557447 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9ab096e3-efab-4d61-9b11-e069aae98e01 req-579b27c2-7ad8-4a58-a28e-8ad747f2837c tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0472953 Nov 11 14:27:49.608176 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9ab096e3-efab-4d61-9b11-e069aae98e01 req-66235ab2-56fd-4766-acb5-b93c15d836b7 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441313 Nov 11 14:27:49.758169 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be9005b-802b-4d58-81c7-1660b1a2998c req-960f29ab-3f47-4597-a665-e4167a7e8ced tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.759820 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8be9005b-802b-4d58-81c7-1660b1a2998c req-960f29ab-3f47-4597-a665-e4167a7e8ced tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0806661 Nov 11 14:27:49.761118 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-8aa338b1-cf82-4d36-ba3c-1c3c22218220 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.762717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-8aa338b1-cf82-4d36-ba3c-1c3c22218220 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1137 time: 0.0564985 Nov 11 14:27:49.785912 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-be12c5de-b6b1-494b-ab59-326d2171ce6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.787356 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-be12c5de-b6b1-494b-ab59-326d2171ce6b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1096 time: 0.0805457 Nov 11 14:27:49.837888 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8be9005b-802b-4d58-81c7-1660b1a2998c req-1365f0d5-f82c-4cde-8cd5-d468005b37f9 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712163 Nov 11 14:27:49.858966 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-80ab4f89-55d9-4bed-b910-318cd0bd6193 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.864707 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-80ab4f89-55d9-4bed-b910-318cd0bd6193 service neutron] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 915 time: 0.0945218 Nov 11 14:27:49.878312 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.11', 50351) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:27:49.935290 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a68b9ab-20d2-4559-836d-bd57c1f5889a req-ea5de151-368a-4778-b04f-398821ce7b24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.936775 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2a68b9ab-20d2-4559-836d-bd57c1f5889a req-ea5de151-368a-4778-b04f-398821ce7b24 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 1098 time: 0.0659766 Nov 11 14:27:49.938083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-5eb05705-af3c-48a9-b647-3ce86a8a9a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.939358 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-5eb05705-af3c-48a9-b647-3ce86a8a9a8b service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.1310160 Nov 11 14:27:49.974245 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-8c3b73e4-85df-40b7-b354-4840c70ad0da service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 1000 time: 0.0807059 Nov 11 14:27:49.976650 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c30dfff-9a58-4b79-b315-99b55759f2b9 req-9aa6b4d3-f253-4e60-aaf7-8465cc719b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:49.978002 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c30dfff-9a58-4b79-b315-99b55759f2b9 req-9aa6b4d3-f253-4e60-aaf7-8465cc719b11 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 1099 time: 0.0922956 Nov 11 14:27:50.038485 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2a68b9ab-20d2-4559-836d-bd57c1f5889a req-d6348485-a327-4528-8ac0-781465cda579 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846906 Nov 11 14:27:50.042390 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-b55c3c94-de51-454f-9c08-f6f9b0364660 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 200 len: 999 time: 0.0876215 Nov 11 14:27:50.058271 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-ce9a1f01-6ec5-4451-bb8e-41a23d4d370f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.059450 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-ce9a1f01-6ec5-4451-bb8e-41a23d4d370f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.0687337 Nov 11 14:27:50.065390 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5c30dfff-9a58-4b79-b315-99b55759f2b9 req-d76fb70b-19be-4961-a7ea-6a44ed4f29a0 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675097 Nov 11 14:27:50.156971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab908a6-de3e-40b7-9a6d-9097382a8678 req-e1fde0cc-01ff-49d3-a1dd-588af1094ef8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.158396 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dab908a6-de3e-40b7-9a6d-9097382a8678 req-e1fde0cc-01ff-49d3-a1dd-588af1094ef8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0515945 Nov 11 14:27:50.203170 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dab908a6-de3e-40b7-9a6d-9097382a8678 req-3e302259-b3b4-467e-9f88-80124ab42b59 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389497 Nov 11 14:27:50.502634 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-46d7e016-f01b-44fd-80d3-93ce2b1e13e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.504243 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-46d7e016-f01b-44fd-80d3-93ce2b1e13e9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435321 Nov 11 14:27:50.505701 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-b42f6b54-6e2f-493c-af59-a36fdaf47453 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.507787 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-b42f6b54-6e2f-493c-af59-a36fdaf47453 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0460951 Nov 11 14:27:50.593897 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-ca863616-ed91-4733-b60a-71e2bbf6979d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.595393 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-ca863616-ed91-4733-b60a-71e2bbf6979d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0749011 Nov 11 14:27:50.603415 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-9aba514c-222f-4868-a10c-a5724d8aceee service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842102 Nov 11 14:27:50.603956 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f2dd32-7b17-402a-92c7-1c2b1ee1beef req-c196a969-4f80-465d-96f2-6ec1e1074752 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.605145 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-18f2dd32-7b17-402a-92c7-1c2b1ee1beef req-c196a969-4f80-465d-96f2-6ec1e1074752 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0581563 Nov 11 14:27:50.726632 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e54e9ad-ed37-418b-8610-2f78ca9a5d14 req-ab2bce97-6327-4ec2-a770-09d977573860 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1163185 Nov 11 14:27:50.730575 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-18f2dd32-7b17-402a-92c7-1c2b1ee1beef req-6fa4654b-d3de-4817-8655-884c100cdd57 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.1176724 Nov 11 14:27:50.736157 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-6680a8d7-131e-4eb4-8602-706a53cc060c service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301157 Nov 11 14:27:50.743658 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b1a2bf-6e2f-45ea-9a6a-fa47500624b0 req-c80416c8-613f-4ed9-bd7f-7b7d2b1c5335 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.751959 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65b1a2bf-6e2f-45ea-9a6a-fa47500624b0 req-c80416c8-613f-4ed9-bd7f-7b7d2b1c5335 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0734434 Nov 11 14:27:50.796909 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65b1a2bf-6e2f-45ea-9a6a-fa47500624b0 req-372ef0f9-68be-49a1-9806-5686313a239a tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432839 Nov 11 14:27:50.833653 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8d7b94b2-a57c-4af8-aa34-075befc183cb req-792a2a59-5a5d-411d-9ef3-3a118b47a125 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874338 Nov 11 14:27:50.963429 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7a92b0-9cda-4f56-9826-58b178cf2b64 req-7db5e0f1-d24d-45f9-beae-4acd3960adf2 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:50.964927 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-af7a92b0-9cda-4f56-9826-58b178cf2b64 req-7db5e0f1-d24d-45f9-beae-4acd3960adf2 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0562308 Nov 11 14:27:51.016722 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-af7a92b0-9cda-4f56-9826-58b178cf2b64 req-2c330422-86af-4bd3-b093-486bca2c4431 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457995 Nov 11 14:27:51.320249 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebd86dc-9ad1-48eb-b28d-89db9d675f9b req-37253944-29bf-4175-aa93-712b9ef0ce1b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:51.321628 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ebd86dc-9ad1-48eb-b28d-89db9d675f9b req-37253944-29bf-4175-aa93-712b9ef0ce1b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0484729 Nov 11 14:27:51.369228 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ebd86dc-9ad1-48eb-b28d-89db9d675f9b req-7fb0c2a5-5c68-4add-8d1b-f160b0dfdb4e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416837 Nov 11 14:27:51.848718 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec3a776-a490-4e8a-98bd-5e5c010f968a req-48aa0ccc-94a8-45ca-adfe-c47883bd7b17 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:51.850822 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bec3a776-a490-4e8a-98bd-5e5c010f968a req-48aa0ccc-94a8-45ca-adfe-c47883bd7b17 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0496039 Nov 11 14:27:51.910870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f65ebe5-b609-4827-a20d-07c66477ac81 req-027596d5-f496-45a8-bf01-c26b872caeac tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:51.912477 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9f65ebe5-b609-4827-a20d-07c66477ac81 req-027596d5-f496-45a8-bf01-c26b872caeac tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0487986 Nov 11 14:27:51.913383 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bec3a776-a490-4e8a-98bd-5e5c010f968a req-ae97463e-4e6f-4c34-95e7-bc4c8156e92b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0560234 Nov 11 14:27:51.966304 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9f65ebe5-b609-4827-a20d-07c66477ac81 req-85f6fdd9-69c0-42d3-bc90-e08c24a62212 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471447 Nov 11 14:27:52.134292 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e4c8c5-fffb-4062-a765-08a0af9092c4 req-2b5e07f1-23c0-4a01-98ec-37c4d1a8d44b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:52.135703 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65e4c8c5-fffb-4062-a765-08a0af9092c4 req-2b5e07f1-23c0-4a01-98ec-37c4d1a8d44b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0521731 Nov 11 14:27:52.183697 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65e4c8c5-fffb-4062-a765-08a0af9092c4 req-cf29b05b-7371-41d1-bdde-2675e7ba3bf0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421369 Nov 11 14:27:52.719642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3951dcf1-0afb-4c31-aeb7-c9a6e2254702 req-48759f26-0abc-4a43-b587-1782e62aaaef tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:52.724585 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3951dcf1-0afb-4c31-aeb7-c9a6e2254702 req-48759f26-0abc-4a43-b587-1782e62aaaef tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0722272 Nov 11 14:27:52.791597 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3951dcf1-0afb-4c31-aeb7-c9a6e2254702 req-25725a0d-070c-412e-9094-8feda2804c72 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571485 Nov 11 14:27:53.027828 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf43eb4-efd4-466b-af31-f95c7cbea5b9 req-d56c5493-3917-4040-af1c-32c81cf741bd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:53.029269 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-acf43eb4-efd4-466b-af31-f95c7cbea5b9 req-d56c5493-3917-4040-af1c-32c81cf741bd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0503509 Nov 11 14:27:53.088346 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-acf43eb4-efd4-466b-af31-f95c7cbea5b9 req-61768cf8-238e-49d3-aacb-63f61898ee68 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0531061 Nov 11 14:27:53.917790 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cb80e1-24a1-4a21-89cf-5f0990337aab req-108c7d34-e4ae-4a88-bf20-17ca4b52cfee tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:53.919242 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b1cb80e1-24a1-4a21-89cf-5f0990337aab req-108c7d34-e4ae-4a88-bf20-17ca4b52cfee tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0523031 Nov 11 14:27:53.965409 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b1cb80e1-24a1-4a21-89cf-5f0990337aab req-0cf08c9b-b4be-42c3-9aed-06153c807503 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402215 Nov 11 14:27:54.204903 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989be973-3b26-434d-8f90-756be4c703a7 req-47964f1d-ccbd-4722-9c6a-815a74637c71 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:54.206461 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-989be973-3b26-434d-8f90-756be4c703a7 req-47964f1d-ccbd-4722-9c6a-815a74637c71 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0515292 Nov 11 14:27:54.266190 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-989be973-3b26-434d-8f90-756be4c703a7 req-59214c07-bab0-4283-84b3-6291cc95a336 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0531342 Nov 11 14:27:55.082812 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33121430-1e00-47f3-9a2c-c1e4ffe55dbc req-7b0db42a-bcc7-404c-8869-7a3a39c40daf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:55.084241 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-33121430-1e00-47f3-9a2c-c1e4ffe55dbc req-7b0db42a-bcc7-404c-8869-7a3a39c40daf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0482302 Nov 11 14:27:55.097835 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-0837046b-ff26-43fb-afb4-cc53c2966779 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:55.099268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-0837046b-ff26-43fb-afb4-cc53c2966779 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1000407 Nov 11 14:27:55.113423 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-29c48f0b-b634-46e2-9667-a6a15a115001 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/quotas/58e5f180c3b54f9882a3b22f6f437768 HTTP/1.1" status: 200 len: 375 time: 0.0086353 Nov 11 14:27:55.135757 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-33121430-1e00-47f3-9a2c-c1e4ffe55dbc req-cac137da-7c75-4ff8-892b-292667884a8d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454845 Nov 11 14:27:55.169008 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-59a52a12-eb56-4682-b07b-733ff1f080cc tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0490613 Nov 11 14:27:55.254123 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-db3db56f-d327-47cd-816d-b655b50782ea service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782168 Nov 11 14:27:55.344136 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-21cd47e2-6ee5-435e-8ec3-6bff181c6ee4 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833926 Nov 11 14:27:55.383781 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6f4834-0177-4e5c-8d6b-51bf8a80cc3a req-32ac6bd4-5edc-45e1-a21a-a0b67c904da9 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:55.390565 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4f6f4834-0177-4e5c-8d6b-51bf8a80cc3a req-32ac6bd4-5edc-45e1-a21a-a0b67c904da9 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0534418 Nov 11 14:27:55.445189 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4f6f4834-0177-4e5c-8d6b-51bf8a80cc3a req-9cc18fa4-54d5-4246-a9a6-97929a03dcd1 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0540755 Nov 11 14:27:55.581692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-616badb7-4396-48e4-bfd7-0c72247bd0db req-c4354d66-fc14-44d5-b0df-9e8641c5daac tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 210 time: 0.0263007 Nov 11 14:27:56.252990 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a6780c-8567-4fe9-9086-6e15cd6a1570 req-526c673f-619e-4e79-9ebf-84deb3ba3c7b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:56.254422 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85a6780c-8567-4fe9-9086-6e15cd6a1570 req-526c673f-619e-4e79-9ebf-84deb3ba3c7b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0474222 Nov 11 14:27:56.303035 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-85a6780c-8567-4fe9-9086-6e15cd6a1570 req-f0858749-628c-4fbe-a87b-0f38767daa18 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418482 Nov 11 14:27:56.561699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-369a3bfb-5803-406c-bdcd-edf6230c6dfb req-a31e88e0-87cc-466d-a4ed-7b1650285aab tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:56.563158 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-369a3bfb-5803-406c-bdcd-edf6230c6dfb req-a31e88e0-87cc-466d-a4ed-7b1650285aab tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0490603 Nov 11 14:27:56.624203 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-369a3bfb-5803-406c-bdcd-edf6230c6dfb req-df492363-db34-49a8-b8f6-8730e229d1a8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0542827 Nov 11 14:27:56.673068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0f91063f-8875-4761-a5db-0e966ee93eca req-6461d21d-e681-4a16-a891-3582c1e888e0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 210 time: 0.0254130 Nov 11 14:27:57.440232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d571b03a-312a-42e6-9610-84cfa1b5a8b3 req-c01be0d3-0bba-4b85-b478-c20ae4b2c5ea tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:57.441641 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d571b03a-312a-42e6-9610-84cfa1b5a8b3 req-c01be0d3-0bba-4b85-b478-c20ae4b2c5ea tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 943 time: 0.0631361 Nov 11 14:27:57.541038 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d571b03a-312a-42e6-9610-84cfa1b5a8b3 req-1b3a2223-f1d9-4b32-9d38-5145f02d94e2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0891018 Nov 11 14:27:57.562977 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-c3a6be96-aedd-4f38-8d45-9ad537ddaca5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:57.564406 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-c3a6be96-aedd-4f38-8d45-9ad537ddaca5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1419168 Nov 11 14:27:57.582954 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Request body: {'port': {'device_id': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'admin_state_up': True, 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:57.746669 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98f0c96-989b-476d-a6b4-8c314be01f02 req-93026bc2-741a-4b77-b197-d0199b1615c8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:57.748175 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f98f0c96-989b-476d-a6b4-8c314be01f02 req-93026bc2-741a-4b77-b197-d0199b1615c8 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0544574 Nov 11 14:27:57.753524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:27:57.756945 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:57.774262 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f8cde8fd-db15-4810-bdc2-69732bd00db2 req-bf8b90ae-4fae-4812-9580-1fe630333e32 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 210 time: 0.0325522 Nov 11 14:27:57.905579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Allocated IP 172.20.0.4 (46c60fd1-4f35-496c-adf1-1f850a03f8d7/8112b7d5-8b09-4390-bcfa-982686a4a63b/0d341f8a-67a3-484b-a551-ccfeea35a818) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:27:58.019721 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f98f0c96-989b-476d-a6b4-8c314be01f02 req-2a67dde0-465c-4500-9047-4839c682b64c tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.2651329 Nov 11 14:27:58.056844 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.098360 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:27:58.143638 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.164871 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859', '71c0d0d0-62c4-4f55-bf50-79e7de51a062'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:58.184010 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:27:58.190818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:27:58.194450 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:27:58.218321 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event updated for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:58.231016 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.231354 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.231706 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.232029 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.232349 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.232666 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.232982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.233294 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.233605 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.233916 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.234225 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.234536 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:27:58.235525 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:58.250341 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4c18064d-696c-4c89-af13-19525b371b78', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4c18064d-696c-4c89-af13-19525b371b78', 'mac_address': 'fa:16:3e:72:b2:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:27:58.257660 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:58.258268 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.321742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.341022 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-163458a1-190c-4c5d-99bd-962da518618a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7615137 Nov 11 14:27:58.344962 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:58.363757 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Request body: {'port': {'device_id': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:27:58.381585 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:27:58.423901 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.468659 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.523970 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=9']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:58.695113 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ab4f3a-a340-4bd2-86b8-72f972d98f5b req-4aabfa81-e234-418a-bdb1-b2574494ee30 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:58.696601 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a9ab4f3a-a340-4bd2-86b8-72f972d98f5b req-4aabfa81-e234-418a-bdb1-b2574494ee30 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.0826757 Nov 11 14:27:58.743106 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d341f8a-67a3-484b-a551-ccfeea35a818 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:27:58.753232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.780281 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Transition to ACTIVE for port object 0d341f8a-67a3-484b-a551-ccfeea35a818 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:27:58.785949 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a9ab4f3a-a340-4bd2-86b8-72f972d98f5b req-ea862beb-b32e-45a5-84db-5dc3857c1799 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670755 Nov 11 14:27:58.846154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:58.853994 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4c18064d-696c-4c89-af13-19525b371b78'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:27:58.894293 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bb927d-6658-4da6-99ff-5606ff8aa92f req-cee5cb1c-16ae-4f47-a1db-5fc17b4b15a8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:58.897672 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a0bb927d-6658-4da6-99ff-5606ff8aa92f req-cee5cb1c-16ae-4f47-a1db-5fc17b4b15a8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 943 time: 0.0549312 Nov 11 14:27:58.897923 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Pushing event updated for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:58.947799 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a0bb927d-6658-4da6-99ff-5606ff8aa92f req-9e8c4077-a662-41cb-b566-223ae3ca6cb8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406771 Nov 11 14:27:58.971870 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Attempting to bind port 0d341f8a-67a3-484b-a551-ccfeea35a818 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:27:58.972202 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Attempting to bind port 0d341f8a-67a3-484b-a551-ccfeea35a818 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:27:58.972540 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Attempting to bind port 0d341f8a-67a3-484b-a551-ccfeea35a818 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:58.977374 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Port 0d341f8a-67a3-484b-a551-ccfeea35a818 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:27:58.977736 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Attempting to bind port 0d341f8a-67a3-484b-a551-ccfeea35a818 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:27:58.982530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 27, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:27:58.982858 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Checking segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:27:58.983677 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Bound using segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:27:58.984106 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Bound port: 0d341f8a-67a3-484b-a551-ccfeea35a818, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:27:58.984490 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:59.053329 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:27:59.056778 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0d341f8a-67a3-484b-a551-ccfeea35a818,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:27:59.103312 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:59.154123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.154898 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:27:59.156397 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] 10.222.0.11 "PUT /v2.0/ports/0d341f8a-67a3-484b-a551-ccfeea35a818 HTTP/1.1" status: 200 len: 1093 time: 0.7982359 Nov 11 14:27:59.159755 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:27:59.162818 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-173265a9-db28-4865-948d-e6c080cd45ee" -d '{"events": [{"name": "network-changed", "server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:27:59.198617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5d31b9-fc1c-4eba-be8d-a492321d2f6c req-3ed112e6-e9f3-4c11-9713-a1180abc657b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.200085 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-af5d31b9-fc1c-4eba-be8d-a492321d2f6c req-3ed112e6-e9f3-4c11-9713-a1180abc657b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.1119878 Nov 11 14:27:59.201783 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:27:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bdacd62f-0e75-4f7a-9e00-5d3632928814 x-openstack-request-id: req-bdacd62f-0e75-4f7a-9e00-5d3632928814 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:27:59.202066 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:27:59.202314 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-bdacd62f-0e75-4f7a-9e00-5d3632928814 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:27:59.202767 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818', 'status': 'completed', 'code': 200} Nov 11 14:27:59.203427 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4f54bb-062e-4780-b3a1-4978069ed88a service neutron] Pushing event updated for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:27:59.298505 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-af5d31b9-fc1c-4eba-be8d-a492321d2f6c req-07cd1a8b-c64b-4a08-a8ee-19fb8074b028 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0909121 Nov 11 14:27:59.307947 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173265a9-db28-4865-948d-e6c080cd45ee req-f63c32b0-08a0-46b9-8366-0287a3660080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.309692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-173265a9-db28-4865-948d-e6c080cd45ee req-f63c32b0-08a0-46b9-8366-0287a3660080 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 1096 time: 0.0811934 Nov 11 14:27:59.652066 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173265a9-db28-4865-948d-e6c080cd45ee req-008ea6ae-1858-491f-bd7c-95e34fb893d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.653513 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-173265a9-db28-4865-948d-e6c080cd45ee req-008ea6ae-1858-491f-bd7c-95e34fb893d3 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=58e5f180c3b54f9882a3b22f6f437768&shared=False HTTP/1.1" status: 200 len: 915 time: 0.3307004 Nov 11 14:27:59.752340 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173265a9-db28-4865-948d-e6c080cd45ee req-2f00639f-6c6e-4da8-8be3-88b4d7e8d02e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.753781 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-173265a9-db28-4865-948d-e6c080cd45ee req-2f00639f-6c6e-4da8-8be3-88b4d7e8d02e service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0930421 Nov 11 14:27:59.834678 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-8760c876-83a9-404e-bd34-927b8c1d65fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.836387 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-8760c876-83a9-404e-bd34-927b8c1d65fb service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 1096 time: 0.0402358 Nov 11 14:27:59.880511 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-d8f02ee7-8a69-42a7-b688-0fe7674d61c5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0d341f8a-67a3-484b-a551-ccfeea35a818 HTTP/1.1" status: 200 len: 217 time: 0.0351193 Nov 11 14:27:59.905618 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48746c9-e114-4045-b594-ff865d9c7ebc req-da8de45e-ce12-4cd6-97ff-b125199888a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.907115 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d48746c9-e114-4045-b594-ff865d9c7ebc req-da8de45e-ce12-4cd6-97ff-b125199888a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 944 time: 0.0477631 Nov 11 14:27:59.936883 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-c25cc2ee-a8a9-4ec0-91d0-b1e1a3b8bf0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:27:59.938367 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-c25cc2ee-a8a9-4ec0-91d0-b1e1a3b8bf0e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=8112b7d5-8b09-4390-bcfa-982686a4a63b HTTP/1.1" status: 200 len: 854 time: 0.0484877 Nov 11 14:27:59.960361 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d48746c9-e114-4045-b594-ff865d9c7ebc req-7380b6e3-5c77-4bd6-95b1-378e11d290dc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461035 Nov 11 14:27:59.971580 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-891b2599-3037-4103-90e2-aa55ff703886 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=46c60fd1-4f35-496c-adf1-1f850a03f8d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0237734 Nov 11 14:28:00.105703 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-20439048-8d1b-458f-884f-e65479872368 service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1199989 Nov 11 14:28:00.113095 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:28:00.113617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46810bf4-19fb-44f3-aa21-7b313485a89f req-3e5bed70-9dcd-48b4-bf17-a046fe03aad3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:00.114889 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-46810bf4-19fb-44f3-aa21-7b313485a89f req-3e5bed70-9dcd-48b4-bf17-a046fe03aad3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 943 time: 0.0758653 Nov 11 14:28:00.174035 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4c18064d-696c-4c89-af13-19525b371b78 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:28:00.174307 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:00.219141 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-46810bf4-19fb-44f3-aa21-7b313485a89f req-1e6bbbde-84e3-430f-9d84-5888aa95f754 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948203 Nov 11 14:28:00.237616 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-28765432-f42c-44e2-96cd-6d5fd088bb22 req-1df8e17c-cc38-4247-9ccb-b1f7c3878dab service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1213138 Nov 11 14:28:00.250186 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:00.272557 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:00.274747 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9065414a-4c00-4261-a975-a4db7b422735" -d '{"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:00.286816 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:00.308881 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b8ba619-a3d3-41db-abde-b3befe972eed x-openstack-request-id: req-9b8ba619-a3d3-41db-abde-b3befe972eed {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:00.309167 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-plugged", "status": "completed", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:00.309454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-9b8ba619-a3d3-41db-abde-b3befe972eed {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:00.309797 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'code': 200} Nov 11 14:28:00.360204 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:00.415020 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=10']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:00.428089 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f33407a6-2d23-445b-9182-03e7ac7dc786 req-19499f47-09ca-4a9f-a5c0-5ed7c3ac94ed tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:00.429494 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f33407a6-2d23-445b-9182-03e7ac7dc786 req-19499f47-09ca-4a9f-a5c0-5ed7c3ac94ed tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0539839 Nov 11 14:28:00.489880 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f33407a6-2d23-445b-9182-03e7ac7dc786 req-e5e995e2-ed17-4060-9485-575dc6ee79d1 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0543926 Nov 11 14:28:00.966615 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e729f5c2-fc42-4d82-be3f-c7a0fb7dc69b req-f4709a39-d537-46b8-ab52-111940b93ab5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:00.968105 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e729f5c2-fc42-4d82-be3f-c7a0fb7dc69b req-f4709a39-d537-46b8-ab52-111940b93ab5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 1099 time: 0.0390470 Nov 11 14:28:01.014685 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e729f5c2-fc42-4d82-be3f-c7a0fb7dc69b req-1d1a3210-e1f9-4ad9-b969-d1aded20866f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391762 Nov 11 14:28:01.084970 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e934ae-5f2f-4d67-b420-e3b8330349c5 req-4878e1d8-6ec1-4680-a66e-54c6a98517a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:01.086421 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46e934ae-5f2f-4d67-b420-e3b8330349c5 req-4878e1d8-6ec1-4680-a66e-54c6a98517a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0478039 Nov 11 14:28:01.133317 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46e934ae-5f2f-4d67-b420-e3b8330349c5 req-81a21284-9e19-4686-b9a2-4f0b248468c3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410781 Nov 11 14:28:01.335250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89324ea-4dfb-41e1-8eb3-14c365e85dda req-a2d683a3-2eda-433f-afc8-0fc1f22cadbd tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:01.338852 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a89324ea-4dfb-41e1-8eb3-14c365e85dda req-a2d683a3-2eda-433f-afc8-0fc1f22cadbd tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 943 time: 0.0519791 Nov 11 14:28:01.385214 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a89324ea-4dfb-41e1-8eb3-14c365e85dda req-0387172e-0d7e-404b-ac0d-651f07cd3567 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421083 Nov 11 14:28:01.603521 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e0906b-61d2-418c-9711-24fce29f2a85 req-10e0710a-54f8-4257-840b-6232f2a3fbd5 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:01.605050 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e0906b-61d2-418c-9711-24fce29f2a85 req-10e0710a-54f8-4257-840b-6232f2a3fbd5 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0486181 Nov 11 14:28:01.666770 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8e0906b-61d2-418c-9711-24fce29f2a85 req-484eb06f-2681-4833-ae78-03888f42abd7 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0556579 Nov 11 14:28:02.250617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1223281a-8435-4e7e-b3b7-e649a0b501ac req-52636815-e27d-4891-b3e9-767058f4b779 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:02.252230 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1223281a-8435-4e7e-b3b7-e649a0b501ac req-52636815-e27d-4891-b3e9-767058f4b779 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0488553 Nov 11 14:28:02.297357 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1223281a-8435-4e7e-b3b7-e649a0b501ac req-3b8be545-7a62-4e70-81e7-a5fbc09e2e60 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396013 Nov 11 14:28:02.499807 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7ee009-cdaf-4344-8588-a3e69e84293f req-d75e5664-50b7-46d5-8b4d-22ae6abed0e0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:02.501362 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d7ee009-cdaf-4344-8588-a3e69e84293f req-d75e5664-50b7-46d5-8b4d-22ae6abed0e0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 943 time: 0.0513635 Nov 11 14:28:02.547689 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7d7ee009-cdaf-4344-8588-a3e69e84293f req-a8b7ded4-bd9a-4b43-918a-a204ca0afb63 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405903 Nov 11 14:28:02.779168 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd18062-690f-44e4-8b21-2448ce4422b8 req-7e8f1857-7034-44fd-80f0-d57833fd664a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:02.780767 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-edd18062-690f-44e4-8b21-2448ce4422b8 req-7e8f1857-7034-44fd-80f0-d57833fd664a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0482583 Nov 11 14:28:02.843006 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-edd18062-690f-44e4-8b21-2448ce4422b8 req-9ba666fb-dcd1-4315-a22b-b75970dd0a1e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0564215 Nov 11 14:28:03.413768 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc2ac3b-bd5d-4580-913e-ee01f46f07ab req-5e96120f-72b9-4c28-b045-fb3a97993f77 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:03.415176 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fc2ac3b-bd5d-4580-913e-ee01f46f07ab req-5e96120f-72b9-4c28-b045-fb3a97993f77 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0480571 Nov 11 14:28:03.463069 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fc2ac3b-bd5d-4580-913e-ee01f46f07ab req-4085eabf-4657-4f72-b23a-c756ab4ed5b7 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415421 Nov 11 14:28:03.658342 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd88665-03e3-4fa8-8c4a-a0706657448a req-6a35b9b0-8882-4fec-b6b8-aa39f95dbb64 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:03.659817 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ffd88665-03e3-4fa8-8c4a-a0706657448a req-6a35b9b0-8882-4fec-b6b8-aa39f95dbb64 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 943 time: 0.0482781 Nov 11 14:28:03.706398 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ffd88665-03e3-4fa8-8c4a-a0706657448a req-211f40f2-a65b-4cf0-9f26-8e2691c0b165 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402765 Nov 11 14:28:03.957169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc5f1a7-857e-4ea2-bac3-5a6462c45572 req-3a2386f0-8171-4854-82a1-0f7407ef63cd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:03.958512 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dfc5f1a7-857e-4ea2-bac3-5a6462c45572 req-3a2386f0-8171-4854-82a1-0f7407ef63cd tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0503716 Nov 11 14:28:03.978004 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0d341f8a-67a3-484b-a551-ccfeea35a818 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:28:04.018545 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dfc5f1a7-857e-4ea2-bac3-5a6462c45572 req-0370a7dc-1753-4d14-a944-51f883a3dbd1 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0534177 Nov 11 14:28:04.092813 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0d341f8a-67a3-484b-a551-ccfeea35a818,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:04.104047 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '0d341f8a-67a3-484b-a551-ccfeea35a818', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'port_id': '0d341f8a-67a3-484b-a551-ccfeea35a818', 'mac_address': 'fa:16:3e:7f:92:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8112b7d5-8b09-4390-bcfa-982686a4a63b', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:28:04.139680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:04.152743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d341f8a-67a3-484b-a551-ccfeea35a818 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:28:04.171564 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0d341f8a-67a3-484b-a551-ccfeea35a818,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:04.222743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:04.268691 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:04.580125 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5692b0-e866-431f-9294-d9d745e1e54b req-6ef7fdb8-1c03-4187-8d0b-8b33e27b7f49 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:04.581589 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1e5692b0-e866-431f-9294-d9d745e1e54b req-6ef7fdb8-1c03-4187-8d0b-8b33e27b7f49 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0479820 Nov 11 14:28:04.629002 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1e5692b0-e866-431f-9294-d9d745e1e54b req-16764493-80b8-4b06-a152-f162a3acf828 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410621 Nov 11 14:28:04.817381 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d21654-5d61-40b3-bea4-14c8e2a7b704 req-45becb96-7f6a-4a22-8415-07b1b25d1dac tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:04.818802 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-10d21654-5d61-40b3-bea4-14c8e2a7b704 req-45becb96-7f6a-4a22-8415-07b1b25d1dac tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 944 time: 0.0484166 Nov 11 14:28:04.864337 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-10d21654-5d61-40b3-bea4-14c8e2a7b704 req-36f96768-52a2-4112-b9c5-441f54d2e51e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398166 Nov 11 14:28:05.135218 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b519f642-5782-4782-8fca-eed8fdbff0e5 req-b6026a5d-5c37-41e5-890f-f3e75c63b0be tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:05.136701 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b519f642-5782-4782-8fca-eed8fdbff0e5 req-b6026a5d-5c37-41e5-890f-f3e75c63b0be tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0515368 Nov 11 14:28:05.194913 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b519f642-5782-4782-8fca-eed8fdbff0e5 req-b8b9800d-7ee9-4766-9dfa-a94b507d2890 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0523520 Nov 11 14:28:05.699175 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['0d341f8a-67a3-484b-a551-ccfeea35a818'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:05.745339 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c777364f-1f16-4289-82c7-b0a5c2afdeb8 req-7ae7090d-1b56-4ed2-8af2-6a5920797ca4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:05.748736 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c777364f-1f16-4289-82c7-b0a5c2afdeb8 req-7ae7090d-1b56-4ed2-8af2-6a5920797ca4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0477824 Nov 11 14:28:05.805268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c777364f-1f16-4289-82c7-b0a5c2afdeb8 req-104293d5-d2a2-40ef-b016-5265c4e0ff9d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493720 Nov 11 14:28:05.986177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cdbaf72-d629-4fa7-9185-81706d925b0d req-693852fe-5d47-4fc7-9014-6b9818a7d81c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:05.987733 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6cdbaf72-d629-4fa7-9185-81706d925b0d req-693852fe-5d47-4fc7-9014-6b9818a7d81c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 944 time: 0.0542929 Nov 11 14:28:06.005584 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7afc5e72-539b-4fe4-b885-500abce2ddae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:06.034774 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6cdbaf72-d629-4fa7-9185-81706d925b0d req-952e3793-c929-4d7e-a1f7-0a4e3b8300da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406728 Nov 11 14:28:06.310343 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-345c45b6-1bf4-460c-a659-c9b611868eb5 req-e05e1fb8-5e17-4b2b-b8f9-f96d8910ed4f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:06.311842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-345c45b6-1bf4-460c-a659-c9b611868eb5 req-e05e1fb8-5e17-4b2b-b8f9-f96d8910ed4f tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0511467 Nov 11 14:28:06.375179 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-345c45b6-1bf4-460c-a659-c9b611868eb5 req-9f456888-6f32-45bb-9be7-adf5240ca155 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0573111 Nov 11 14:28:06.934524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da30fd7f-89f6-4b91-b5ae-75d7ee90cb8e req-5acf0432-988e-4f0b-836d-2c73b5aefdc6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:06.934524 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-da30fd7f-89f6-4b91-b5ae-75d7ee90cb8e req-5acf0432-988e-4f0b-836d-2c73b5aefdc6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0534337 Nov 11 14:28:06.986638 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-da30fd7f-89f6-4b91-b5ae-75d7ee90cb8e req-6b0c9a2c-f37b-4dfa-b4f0-a0d349a324ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467269 Nov 11 14:28:07.155219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f1223a-b6ff-4b26-8baa-56109fb232c1 req-c7f1c26c-26b9-4a0e-96cb-848646f01e7c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:07.156742 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c9f1223a-b6ff-4b26-8baa-56109fb232c1 req-c7f1c26c-26b9-4a0e-96cb-848646f01e7c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 944 time: 0.0499079 Nov 11 14:28:07.203469 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c9f1223a-b6ff-4b26-8baa-56109fb232c1 req-199317e9-9963-4c42-9a11-6e1dad5c85aa tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396843 Nov 11 14:28:07.229666 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0d341f8a-67a3-484b-a551-ccfeea35a818 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:28:07.348508 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 0d341f8a-67a3-484b-a551-ccfeea35a818 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:28:07.352374 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 0d341f8a-67a3-484b-a551-ccfeea35a818 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:28:07.352734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:07.441060 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:07.465383 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:07.467565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c3634f4-d202-47b5-a8f0-d58833d762e5" -d '{"events": [{"server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "name": "network-vif-plugged", "status": "completed", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:07.480272 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0d341f8a-67a3-484b-a551-ccfeea35a818,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:07.493584 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e571d1-fdbf-4c55-a1dd-122c7be7a826 req-00d9c93b-aaee-4d91-ab4d-e377d1492dd1 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:07.495052 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-56e571d1-fdbf-4c55-a1dd-122c7be7a826 req-00d9c93b-aaee-4d91-ab4d-e377d1492dd1 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0500691 Nov 11 14:28:07.503879 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15e75664-b159-4346-bd45-6a346a8981bc x-openstack-request-id: req-15e75664-b159-4346-bd45-6a346a8981bc {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:07.508381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "name": "network-vif-plugged", "status": "completed", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:07.508381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-15e75664-b159-4346-bd45-6a346a8981bc {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:07.508381 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818', 'code': 200} Nov 11 14:28:07.554395 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:07.557187 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-56e571d1-fdbf-4c55-a1dd-122c7be7a826 req-4228fe43-8d23-48fc-99d5-2a208eb1d1b9 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=a82016f9-d4d9-4029-9b9a-5e4865705f55&id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0550292 Nov 11 14:28:07.604307 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:08.109573 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afefb27-7d6d-45fb-b067-44b9f48517ab req-ab5cd1b7-4669-49bc-9e0f-5a34298438c2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:08.111082 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9afefb27-7d6d-45fb-b067-44b9f48517ab req-ab5cd1b7-4669-49bc-9e0f-5a34298438c2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0517986 Nov 11 14:28:08.157560 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9afefb27-7d6d-45fb-b067-44b9f48517ab req-86ed316a-73b7-47ea-8d44-fb38224ad13c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398862 Nov 11 14:28:08.314311 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5208f7-5c4c-4188-88ef-e8e6d3105814 req-587fed45-9f53-4133-9314-58e02dc9415b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:08.315778 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0e5208f7-5c4c-4188-88ef-e8e6d3105814 req-587fed45-9f53-4133-9314-58e02dc9415b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0482039 Nov 11 14:28:08.364784 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0e5208f7-5c4c-4188-88ef-e8e6d3105814 req-e78fd8cc-6af4-43f9-9cac-6d3e588034d5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429540 Nov 11 14:28:08.445597 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-38e62f8f-b3e7-4db8-b9f2-ffbddecda5b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:09.488225 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f390e190-5a97-404b-8982-94a9a383b6dd req-65f44e54-0799-427f-becd-4b0b2c9e7169 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:09.489667 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f390e190-5a97-404b-8982-94a9a383b6dd req-65f44e54-0799-427f-becd-4b0b2c9e7169 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0484617 Nov 11 14:28:09.535506 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f390e190-5a97-404b-8982-94a9a383b6dd req-a57878cc-6a96-4067-a7a3-9b32cfd79481 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393112 Nov 11 14:28:09.610941 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:10.651507 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207d818c-f5ce-4112-b511-61368fb93ced req-8eea23c2-4b20-4ed4-b7c0-bec252cc093b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:10.652983 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-207d818c-f5ce-4112-b511-61368fb93ced req-8eea23c2-4b20-4ed4-b7c0-bec252cc093b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0486631 Nov 11 14:28:10.703031 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-207d818c-f5ce-4112-b511-61368fb93ced req-82cac5e7-8658-4d21-9d35-d44fc3051597 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437334 Nov 11 14:28:10.713846 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:10.761895 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a459da7c-4476-4efc-b056-843949c44ec4 req-8fac4812-192d-4fc8-ada3-658b879ed2b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:10.763340 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a459da7c-4476-4efc-b056-843949c44ec4 req-8fac4812-192d-4fc8-ada3-658b879ed2b9 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 1098 time: 0.0403988 Nov 11 14:28:10.813410 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a459da7c-4476-4efc-b056-843949c44ec4 req-428676e5-07de-4833-b9f0-58c79316c0a8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366561 Nov 11 14:28:11.696575 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:11.817529 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f5ad5d-b307-4b68-b4fb-7f05c4e049d8 req-4df13d50-d327-4bfd-8c00-d418e38dd6c5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:11.819023 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b6f5ad5d-b307-4b68-b4fb-7f05c4e049d8 req-4df13d50-d327-4bfd-8c00-d418e38dd6c5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0489140 Nov 11 14:28:11.867824 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b6f5ad5d-b307-4b68-b4fb-7f05c4e049d8 req-29b5af31-4e95-4113-a12f-0be65d37b245 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427811 Nov 11 14:28:12.045554 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:12.981227 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf3c66a-7619-4603-b5fd-000052b75a03 req-7b64cd96-24b0-463d-bcc1-029b43b9f4d7 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:12.982729 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0bf3c66a-7619-4603-b5fd-000052b75a03 req-7b64cd96-24b0-463d-bcc1-029b43b9f4d7 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0509622 Nov 11 14:28:13.029639 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0bf3c66a-7619-4603-b5fd-000052b75a03 req-f20239d2-a638-48a6-aef1-d2c72ad933fd tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409946 Nov 11 14:28:16.334770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d931ed2-71c0-44c8-969a-231a327dacee req-0b7657d2-4603-4782-a458-8eaa94bffb01 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:16.336277 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d931ed2-71c0-44c8-969a-231a327dacee req-0b7657d2-4603-4782-a458-8eaa94bffb01 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0496073 Nov 11 14:28:16.382016 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5d931ed2-71c0-44c8-969a-231a327dacee req-f4d7f646-1085-448c-a12d-544cc040578a tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396986 Nov 11 14:28:17.496987 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562f3adb-335b-4a1d-9e07-33cafa8a5817 req-d94b0e0e-f643-40ff-9d88-20fdb56d03be tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:17.498437 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-562f3adb-335b-4a1d-9e07-33cafa8a5817 req-d94b0e0e-f643-40ff-9d88-20fdb56d03be tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0482795 Nov 11 14:28:17.544345 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-562f3adb-335b-4a1d-9e07-33cafa8a5817 req-46351410-86d5-4f2f-8769-4a190f954da7 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400653 Nov 11 14:28:18.608786 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-13eefffb-b8d8-4e4e-bf05-c1decf1c71f6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:18.610223 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-13eefffb-b8d8-4e4e-bf05-c1decf1c71f6 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0479450 Nov 11 14:28:18.657377 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6207f7de-0df4-4553-ae38-87197bc65813 req-3dec4ce0-11c5-46a0-b7a7-e8c510664664 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:18.658785 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6207f7de-0df4-4553-ae38-87197bc65813 req-3dec4ce0-11c5-46a0-b7a7-e8c510664664 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 945 time: 0.0485036 Nov 11 14:28:18.705853 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6207f7de-0df4-4553-ae38-87197bc65813 req-f65784f6-f57e-42ac-bd39-8160bda664d3 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/security-groups?id=14ff9c30-b4b4-488a-99fe-4ff6878884d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406749 Nov 11 14:28:18.707896 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Deleting port e0e11b87-adf9-4797-b1df-ffbee2c9c622 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:28:18.708229 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:18.799749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] For port e0e11b87-adf9-4797-b1df-ffbee2c9c622, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=e0e11b87-adf9-4797-b1df-ffbee2c9c622,segment=NetworkSegment(ddeb9def-079c-4756-a438-c91278e6acb9),segment_id=ddeb9def-079c-4756-a438-c91278e6acb9)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:18.800104 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:18.812420 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Calling delete_port for e0e11b87-adf9-4797-b1df-ffbee2c9c622 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:28:18.993524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:19.007163 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['e0e11b87-adf9-4797-b1df-ffbee2c9c622'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:19.030861 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Pushing event deleted for resources: {'Port': ['ID=e0e11b87-adf9-4797-b1df-ffbee2c9c622,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:19.063990 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] No DVR routers for this DVR port e0e11b87-adf9-4797-b1df-ffbee2c9c622 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:28:19.066387 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:19.069753 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63552575-7afd-441e-9dd9-0a2bcf698d98 req-3f6d8ef9-5655-4d77-9b7b-772d8064abf1 tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.11 "DELETE /v2.0/ports/e0e11b87-adf9-4797-b1df-ffbee2c9c622 HTTP/1.1" status: 204 len: 173 time: 0.4517732 Nov 11 14:28:19.070182 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'name': 'network-vif-deleted', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:19.072418 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc42a79c-8c8c-4f9d-95a5-4c680ca24fea" -d '{"events": [{"server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "name": "network-vif-deleted", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:19.107251 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f0c4239-6d92-40d8-8a0a-296253fbba73 x-openstack-request-id: req-9f0c4239-6d92-40d8-8a0a-296253fbba73 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:19.107592 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5121b9ea-7e46-4165-9ee2-30f50230ba08", "name": "network-vif-deleted", "tag": "e0e11b87-adf9-4797-b1df-ffbee2c9c622", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:19.109919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-9f0c4239-6d92-40d8-8a0a-296253fbba73 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:19.109919 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5121b9ea-7e46-4165-9ee2-30f50230ba08', 'name': 'network-vif-deleted', 'tag': 'e0e11b87-adf9-4797-b1df-ffbee2c9c622', 'status': 'completed', 'code': 200} Nov 11 14:28:19.813020 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-76327a92-3b10-4e63-93b8-9cd5a69afca1 req-6de64c2a-1e14-4cf1-afc3-e199a93c161d tempest-VolumesSnapshotTestJSON-399394484 tempest-VolumesSnapshotTestJSON-399394484-project] 10.222.0.10 "GET /v2.0/ports?device_id=5121b9ea-7e46-4165-9ee2-30f50230ba08 HTTP/1.1" status: 200 len: 210 time: 0.0292516 Nov 11 14:28:21.353524 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:28:25.004056 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device e0e11b87-adf9-4797-b1df-ffbee2c9c622 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:28:25.024285 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: e0e11b87-adf9-4797-b1df-ffbee2c9c622 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:28:25.024623 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device e0e11b87-adf9-4797-b1df-ffbee2c9c622 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:28:27.550076 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-d12665ab-d94a-4890-9f94-ac5e090854bb tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:27.551466 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-d12665ab-d94a-4890-9f94-ac5e090854bb tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1005101 Nov 11 14:28:27.565924 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-18bbc71f-e6a1-4af6-9902-4f041120c172 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/quotas/58e5f180c3b54f9882a3b22f6f437768 HTTP/1.1" status: 200 len: 375 time: 0.0086799 Nov 11 14:28:27.616991 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-21d9ddd8-29be-4a42-9f94-4eaf26c3b2d8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0456135 Nov 11 14:28:27.708109 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-e86830aa-8578-469d-84dd-a7673c347820 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843484 Nov 11 14:28:27.800360 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-859abe8e-1b40-4e34-81e7-150418224e82 service neutron] 10.222.0.10 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856199 Nov 11 14:28:28.029403 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4aaac23a-3cee-446c-a11f-6918b91e90e0 req-a65c5969-ceed-4c87-9589-e713fd81baed tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 210 time: 0.0274596 Nov 11 14:28:29.122472 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c7553a4a-9917-4692-a7be-4b7a38e49d7c req-2dbb1c2e-7604-4a0f-918f-dbcd05e662ea tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 210 time: 0.0257504 Nov 11 14:28:30.066842 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-118944db-5c68-45cd-bf68-8a56ce787436 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:30.068515 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-118944db-5c68-45cd-bf68-8a56ce787436 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/networks?id=46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 200 len: 814 time: 0.1104553 Nov 11 14:28:30.095152 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Request body: {'port': {'device_id': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'admin_state_up': True, 'tenant_id': '58e5f180c3b54f9882a3b22f6f437768'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:28:30.238594 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f6185d5c-f886-4bdb-9efe-579fec39cc4f req-c9dbd400-da7a-435c-84b9-2d0d04e9a71a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 210 time: 0.0346270 Nov 11 14:28:30.302035 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Made reservation on behalf of 58e5f180c3b54f9882a3b22f6f437768 for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:28:30.306312 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:30.434470 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Allocated IP 172.20.0.11 (46c60fd1-4f35-496c-adf1-1f850a03f8d7/8112b7d5-8b09-4390-bcfa-982686a4a63b/5177a4d7-78e6-4641-b951-6a89c3c7e015) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:28:30.588826 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:30.679542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:30.691196 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859', '71c0d0d0-62c4-4f55-bf50-79e7de51a062', '0d341f8a-67a3-484b-a551-ccfeea35a818'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:30.718528 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:28:30.721643 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:28:30.728449 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:28:30.753531 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event updated for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:30.781396 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:30.782098 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:30.876337 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-03ee628c-481b-467c-94b7-332fc7d1014b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7850170 Nov 11 14:28:30.890277 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Request body: {'port': {'device_id': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:28:30.947734 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.203888 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5177a4d7-78e6-4641-b951-6a89c3c7e015 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:28:31.211684 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.222988 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Transition to ACTIVE for port object 5177a4d7-78e6-4641-b951-6a89c3c7e015 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:28:31.302441 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.368792 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cf55e1-db9d-4e99-96c1-360bef567d32 req-fa74a432-c302-423a-aec3-4a70ff46d831 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:31.370312 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6cf55e1-db9d-4e99-96c1-360bef567d32 req-fa74a432-c302-423a-aec3-4a70ff46d831 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.0575423 Nov 11 14:28:31.389447 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Pushing event updated for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:31.421017 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d6cf55e1-db9d-4e99-96c1-360bef567d32 req-9ccf2f80-5201-4dc9-b8e0-8e86c0d7c60f tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439336 Nov 11 14:28:31.441118 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Attempting to bind port 5177a4d7-78e6-4641-b951-6a89c3c7e015 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:28:31.441411 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Attempting to bind port 5177a4d7-78e6-4641-b951-6a89c3c7e015 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:28:31.441735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Attempting to bind port 5177a4d7-78e6-4641-b951-6a89c3c7e015 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:28:31.446559 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Port 5177a4d7-78e6-4641-b951-6a89c3c7e015 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:28:31.446871 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Attempting to bind port 5177a4d7-78e6-4641-b951-6a89c3c7e015 on network 46c60fd1-4f35-496c-adf1-1f850a03f8d7 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:28:31.451667 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 28, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:28:31.451992 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Checking segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:28:31.452366 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Bound using segment: {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:28:31.452784 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Bound port: 5177a4d7-78e6-4641-b951-6a89c3c7e015, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a261d729-bba1-440e-ba21-5fcca20345f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 342, 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:28:31.453129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.515756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:28:31.518709 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:28:31.593620 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.625932 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:31.626579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:31.627970 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] 10.222.0.11 "PUT /v2.0/ports/5177a4d7-78e6-4641-b951-6a89c3c7e015 HTTP/1.1" status: 200 len: 1094 time: 0.7418058 Nov 11 14:28:31.628402 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:31.635855 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53fa2df9-5852-4499-94ec-dc6405afb917" -d '{"events": [{"name": "network-changed", "server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:31.674083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51aa66c-1913-4e4e-9512-6cf5cbaab1b6 service neutron] Pushing event updated for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:31.678082 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5725128-5dcd-4884-ad38-64d1e82120a1 x-openstack-request-id: req-a5725128-5dcd-4884-ad38-64d1e82120a1 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:31.678364 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:31.678612 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a5725128-5dcd-4884-ad38-64d1e82120a1 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:31.678989 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015', 'status': 'completed', 'code': 200} Nov 11 14:28:31.750256 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-a4a23bc5-8e96-42eb-b4d9-d7da956c4c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:31.751667 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-a4a23bc5-8e96-42eb-b4d9-d7da956c4c91 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 1097 time: 0.0437832 Nov 11 14:28:31.855481 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-da119fff-32e0-4666-ad6f-307704a2a4fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:31.856914 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-da119fff-32e0-4666-ad6f-307704a2a4fb service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=58e5f180c3b54f9882a3b22f6f437768&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0919421 Nov 11 14:28:31.958702 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-472cbd54-e475-48f3-af78-10acbae77e6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:31.960204 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-53fa2df9-5852-4499-94ec-dc6405afb917 req-472cbd54-e475-48f3-af78-10acbae77e6c service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0917754 Nov 11 14:28:32.046666 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-5f7c5513-2b07-4046-9553-72df2b53d763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:32.048081 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-5f7c5513-2b07-4046-9553-72df2b53d763 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=58e5f180c3b54f9882a3b22f6f437768&device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 1097 time: 0.0393977 Nov 11 14:28:32.092155 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-8fa37570-0981-4646-8f63-9480fb8aca91 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015 HTTP/1.1" status: 200 len: 217 time: 0.0330172 Nov 11 14:28:32.541464 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09c1596-993e-470b-a751-303c5d664795 req-aadcd5b1-5fe2-42d7-ab5b-b6056d9885f3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:32.542934 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e09c1596-993e-470b-a751-303c5d664795 req-aadcd5b1-5fe2-42d7-ab5b-b6056d9885f3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.0560250 Nov 11 14:28:32.591480 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e09c1596-993e-470b-a751-303c5d664795 req-1b1c81cf-eccc-420d-81d1-295acdad65e8 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426538 Nov 11 14:28:33.187914 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-e18a80e9-3602-4f09-ba33-f4617719c36a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:33.189284 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-e18a80e9-3602-4f09-ba33-f4617719c36a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=8112b7d5-8b09-4390-bcfa-982686a4a63b HTTP/1.1" status: 200 len: 854 time: 0.0462945 Nov 11 14:28:33.706342 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912c4263-4155-49bd-b519-61505c813fbe req-081b17d5-9a64-42a7-967c-e0d4dada44da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:33.707817 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-912c4263-4155-49bd-b519-61505c813fbe req-081b17d5-9a64-42a7-967c-e0d4dada44da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.0485382 Nov 11 14:28:33.755000 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-912c4263-4155-49bd-b519-61505c813fbe req-e1a8d845-373b-4757-8102-257959e1a1d1 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409214 Nov 11 14:28:34.041872 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-86433169-3689-49dc-99e7-f1a3aac32a11 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=46c60fd1-4f35-496c-adf1-1f850a03f8d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250530 Nov 11 14:28:34.912450 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2cc6a8-e08d-4e1b-8ecf-3bb5d3e4cbe8 req-d017d92a-ef22-44b2-acc1-84690aed190c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:34.913901 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa2cc6a8-e08d-4e1b-8ecf-3bb5d3e4cbe8 req-d017d92a-ef22-44b2-acc1-84690aed190c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.0955007 Nov 11 14:28:34.960468 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa2cc6a8-e08d-4e1b-8ecf-3bb5d3e4cbe8 req-2ab697a5-5a7d-4247-a370-7652a4867888 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407014 Nov 11 14:28:35.139080 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-b69fd2c6-b15a-42df-aaaa-97c54c43df57 service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852180 Nov 11 14:28:35.229387 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6585bead-e150-4c7a-86bb-b63c594b0b99 req-2dfd4dd5-8d5d-4f48-ab22-3dbded849ee5 service neutron] 10.222.0.11 "GET /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810354 Nov 11 14:28:36.033639 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c84d7835-2d07-4e79-a520-a78b185e2a92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:36.144940 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30414d7c-47ee-4cb1-b631-3b19e49847b2 req-d86a589c-c3c9-4f07-b124-4e23626b016c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:36.146745 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-30414d7c-47ee-4cb1-b631-3b19e49847b2 req-d86a589c-c3c9-4f07-b124-4e23626b016c tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.1149056 Nov 11 14:28:36.192084 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-30414d7c-47ee-4cb1-b631-3b19e49847b2 req-64012470-993f-46bb-891e-d8bcea232e5d tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394533 Nov 11 14:28:37.305388 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24ca170-d9a0-49aa-a267-da466cbd3682 req-9d157c0e-2868-4d9c-bbc3-5edecf28044d tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:37.306839 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f24ca170-d9a0-49aa-a267-da466cbd3682 req-9d157c0e-2868-4d9c-bbc3-5edecf28044d tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 944 time: 0.0477557 Nov 11 14:28:37.353534 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f24ca170-d9a0-49aa-a267-da466cbd3682 req-9a744d21-f61c-41dc-86b9-daf7c80cd900 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407636 Nov 11 14:28:38.080950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5177a4d7-78e6-4641-b951-6a89c3c7e015 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:28:38.176718 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:38.188122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '5177a4d7-78e6-4641-b951-6a89c3c7e015', 'network_id': '46c60fd1-4f35-496c-adf1-1f850a03f8d7', 'port_id': '5177a4d7-78e6-4641-b951-6a89c3c7e015', 'mac_address': 'fa:16:3e:bf:ac:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8112b7d5-8b09-4390-bcfa-982686a4a63b', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:28:38.223256 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:38.236083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5177a4d7-78e6-4641-b951-6a89c3c7e015 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:28:38.254553 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:38.330441 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:38.386652 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:38.393812 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.394394 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.394734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.395063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.395460 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.395734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.396314 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.396630 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.396979 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.397274 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.397589 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.397899 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:38.468265 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24657d3-c7eb-4d00-9f83-7a6bbf16b5e3 req-8fc632e9-e8d9-4147-b4bd-74d15a7916bf tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:38.469725 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b24657d3-c7eb-4d00-9f83-7a6bbf16b5e3 req-8fc632e9-e8d9-4147-b4bd-74d15a7916bf tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 945 time: 0.0495987 Nov 11 14:28:38.484905 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7a22a4fb-4099-4860-b0d0-55a50a04a33f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:38.518460 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b24657d3-c7eb-4d00-9f83-7a6bbf16b5e3 req-e828df6b-4d59-4344-a2b8-68e29a5a6aff tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423193 Nov 11 14:28:38.634216 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['5177a4d7-78e6-4641-b951-6a89c3c7e015'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:39.650139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:39.656526 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa74d30a-2fc9-478e-9765-bdb9b08ff03d req-879f8172-f59a-4ae3-bdba-d63f406dfe30 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:39.658008 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa74d30a-2fc9-478e-9765-bdb9b08ff03d req-879f8172-f59a-4ae3-bdba-d63f406dfe30 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 945 time: 0.0549154 Nov 11 14:28:39.705707 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa74d30a-2fc9-478e-9765-bdb9b08ff03d req-3790f54b-c82d-45a0-924f-224b75f5371b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415609 Nov 11 14:28:40.110316 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5177a4d7-78e6-4641-b951-6a89c3c7e015 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:28:40.210260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 5177a4d7-78e6-4641-b951-6a89c3c7e015 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:28:40.213796 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 5177a4d7-78e6-4641-b951-6a89c3c7e015 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:28:40.214159 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:40.291635 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:40.314077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:40.316388 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be7fb5e8-ff44-4d20-a9cc-8b223df82861" -d '{"events": [{"server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "name": "network-vif-plugged", "status": "completed", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:40.328378 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:40.357284 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ac5482a-2017-42f0-9699-b21a30d34fdd x-openstack-request-id: req-4ac5482a-2017-42f0-9699-b21a30d34fdd {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:40.357284 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "name": "network-vif-plugged", "status": "completed", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:40.357284 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4ac5482a-2017-42f0-9699-b21a30d34fdd {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:40.357284 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015', 'code': 200} Nov 11 14:28:40.432946 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:40.479581 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:40.725044 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:40.749179 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34717b38-cde5-46f2-9606-068449690f00 req-918696ec-1bd5-4e0e-863e-75ecc3ce9190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:40.750675 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-34717b38-cde5-46f2-9606-068449690f00 req-918696ec-1bd5-4e0e-863e-75ecc3ce9190 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 1099 time: 0.0436006 Nov 11 14:28:40.798444 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-34717b38-cde5-46f2-9606-068449690f00 req-7af6693d-204b-4220-bf20-54e014fcc93a service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371850 Nov 11 14:28:40.818544 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb77aa3-2776-4599-aed2-24ac1e72510b req-823c7e65-b324-43bc-81b0-33fcceb6589e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:40.820027 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-beb77aa3-2776-4599-aed2-24ac1e72510b req-823c7e65-b324-43bc-81b0-33fcceb6589e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0495157 Nov 11 14:28:40.865931 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-beb77aa3-2776-4599-aed2-24ac1e72510b req-e608afba-55ce-485b-bdef-3c6e28b0b6ea tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400531 Nov 11 14:28:41.631734 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-1581de8d-14b4-4433-ac24-d5e41a6059a2 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401182 Nov 11 14:28:41.696766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-ba510613-de2e-4fcb-a456-535853aab315 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:41.698219 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-ba510613-de2e-4fcb-a456-535853aab315 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 1099 time: 0.0407190 Nov 11 14:28:41.701695 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:41.809369 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-84a5078d-6bb5-41ed-8655-ba0d7b6fe086 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:41.810793 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-84a5078d-6bb5-41ed-8655-ba0d7b6fe086 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.0896719 Nov 11 14:28:41.883291 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-2c5e286b-3689-498f-b672-3ae6917be3ac service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 200 len: 1002 time: 0.0570300 Nov 11 14:28:41.952737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-7737d33e-0987-49e1-9afd-e65009b825d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:41.954100 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-7737d33e-0987-49e1-9afd-e65009b825d7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0560825 Nov 11 14:28:42.018835 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c4fd0f-4fc8-4b98-9965-2de438a1b081 req-404e2160-e78b-48b7-b7ed-b94e91a2bf02 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:42.021092 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9c4fd0f-4fc8-4b98-9965-2de438a1b081 req-404e2160-e78b-48b7-b7ed-b94e91a2bf02 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0812836 Nov 11 14:28:42.026351 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-c2ff08b2-b61c-4d26-9286-3570a0ebb4a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:42.027828 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-c2ff08b2-b61c-4d26-9286-3570a0ebb4a3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0591359 Nov 11 14:28:42.090455 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:42.119654 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b9c4fd0f-4fc8-4b98-9965-2de438a1b081 req-7877cea4-59bf-41de-8ce2-01292ad7c1ed tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908797 Nov 11 14:28:42.151528 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-b9636b4c-803d-4a7e-a9d6-292bda2ee413 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1063025 Nov 11 14:28:42.246091 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-17a635f4-efe2-4267-a933-4f9171baf4c7 req-305ec3bb-e4c8-4d7f-9039-8d505f62acd2 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810912 Nov 11 14:28:43.232114 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc219eac-e1aa-4b6c-a919-78198e55f523 req-c0a520bd-8589-4cbf-89c9-f9d4eb03d0df tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:43.233544 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc219eac-e1aa-4b6c-a919-78198e55f523 req-c0a520bd-8589-4cbf-89c9-f9d4eb03d0df tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0470755 Nov 11 14:28:43.282566 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc219eac-e1aa-4b6c-a919-78198e55f523 req-cb2855eb-56e4-4d58-864f-704ccd6120fe tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433187 Nov 11 14:28:46.216411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36518) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:28:46.261609 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Deleting subnet 65ef7658-e991-4281-b272-34a0d1d881ca {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:28:46.266198 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.303720 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.347183 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.388948 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456372a3-e100-4446-9b47-66f14757d820 req-ed036c78-c734-4521-90d1-abf113bfe0ae tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:46.390663 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-456372a3-e100-4446-9b47-66f14757d820 req-ed036c78-c734-4521-90d1-abf113bfe0ae tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0527282 Nov 11 14:28:46.441036 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-456372a3-e100-4446-9b47-66f14757d820 req-a64761b2-6c47-403e-8d06-e40833e50754 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425463 Nov 11 14:28:46.513448 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.539182 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65ef7658-e991-4281-b272-34a0d1d881ca,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:46.543811 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.548433 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/65ef7658-e991-4281-b272-34a0d1d881ca HTTP/1.1" status: 204 len: 168 time: 0.3294454 Nov 11 14:28:46.549806 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36522) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:28:46.553389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.553389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.553389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.553389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.554407 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.554407 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.554407 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.554646 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.554893 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.555449 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.555555 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.555843 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47b77b-eb74-49ba-802f-838d0bbcdfe0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:46.620990 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.708922 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.729121 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2a4362f2-7b3c-4c53-9f46-25425c5daaf7']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:46.737970 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ddeb9def-079c-4756-a438-c91278e6acb9') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:46.738255 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ddeb9def-079c-4756-a438-c91278e6acb9') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:46.747235 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.760581 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.766298 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Releasing vlan 305 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:28:46.766606 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:28:46.768211 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:28:46.890014 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.896250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:46.899511 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] 10.222.0.10 "DELETE /v2.0/networks/2a4362f2-7b3c-4c53-9f46-25425c5daaf7 HTTP/1.1" status: 204 len: 168 time: 0.3486943 Nov 11 14:28:46.910564 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bdef3b7-b0dc-4ccc-bec7-5c742cdae5ae admin admin] Pushing event deleted for resources: {'Network': ['ID=2a4362f2-7b3c-4c53-9f46-25425c5daaf7,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:47.202033 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36528) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:28:47.240900 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-45e227a4-9564-4af9-a429-158fa12ed5be admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=67dc223b706f43978cc8671a6462f9d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0377524 Nov 11 14:28:47.243222 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36530) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:28:47.288519 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:47.309365 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:47.416000 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:47.418500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:47.419813 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/14ff9c30-b4b4-488a-99fe-4ff6878884d9 HTTP/1.1" status: 204 len: 168 time: 0.1755123 Nov 11 14:28:47.428342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e2ef99-874c-44b9-a3a2-e5e8ae8bd22c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14ff9c30-b4b4-488a-99fe-4ff6878884d9,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:47.562559 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f058c40-48f4-47c8-87a0-7ec654145ed5 req-5745ee19-c5a6-4824-bdde-167d06bb006b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:47.564113 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8f058c40-48f4-47c8-87a0-7ec654145ed5 req-5745ee19-c5a6-4824-bdde-167d06bb006b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0528967 Nov 11 14:28:47.612976 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8f058c40-48f4-47c8-87a0-7ec654145ed5 req-dc2e2044-6950-4ede-86ec-22e1a121a1eb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428934 Nov 11 14:28:48.225276 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-6ad7bbf8-01a8-4274-8c97-72e6b9e359bd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:48.226680 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-6ad7bbf8-01a8-4274-8c97-72e6b9e359bd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.0471749 Nov 11 14:28:48.319539 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port a304cf63-faf2-4bfa-964d-9112da652ad0 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:28:48.319866 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:48.647554 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] For port a304cf63-faf2-4bfa-964d-9112da652ad0, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a304cf63-faf2-4bfa-964d-9112da652ad0,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:48.647912 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:48.825017 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0075538-7f5e-4d4d-a2bb-3392868708d2 req-8da32266-891a-4132-8ae8-eef854a84437 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:48.826476 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c0075538-7f5e-4d4d-a2bb-3392868708d2 req-8da32266-891a-4132-8ae8-eef854a84437 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 946 time: 0.1166050 Nov 11 14:28:48.924247 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c0075538-7f5e-4d4d-a2bb-3392868708d2 req-59fb8ffe-a1b6-4ab8-8d10-8cca5a6ee4f7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911078 Nov 11 14:28:48.937329 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:48.937666 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:48.937978 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP a694a2ce-d3e1-4299-958e-45c6bc8c4054 disassociated. External IP: 172.27.1.210, port: a304cf63-faf2-4bfa-964d-9112da652ad0. Nov 11 14:28:48.938334 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for a304cf63-faf2-4bfa-964d-9112da652ad0 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:28:49.136057 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:49.163587 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=a304cf63-faf2-4bfa-964d-9112da652ad0,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:49.278704 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:28:49.387656 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:28:49.397922 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:28:49.408163 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:28:49.408802 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:49.429015 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] No DVR routers for this DVR port a304cf63-faf2-4bfa-964d-9112da652ad0 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:28:49.431557 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:49.434842 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d12117a7-bd31-43b6-b7d6-6a0ff99818e8 req-ae7dd6f6-202d-424f-b3c4-1a431bb0874a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "DELETE /v2.0/ports/a304cf63-faf2-4bfa-964d-9112da652ad0 HTTP/1.1" status: 204 len: 173 time: 1.1978333 Nov 11 14:28:49.435274 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'name': 'network-vif-deleted', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:49.437556 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba6e035e-3bc4-4918-9124-53c72bc37831" -d '{"events": [{"server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "name": "network-vif-deleted", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:49.477977 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b49147ee-ed7b-4734-addf-a0f3fc07927b x-openstack-request-id: req-b49147ee-ed7b-4734-addf-a0f3fc07927b {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:49.478430 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdeccc0b-895b-4d5b-a9a4-ef5646040d20", "name": "network-vif-deleted", "tag": "a304cf63-faf2-4bfa-964d-9112da652ad0", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:49.478740 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-b49147ee-ed7b-4734-addf-a0f3fc07927b {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:49.479190 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdeccc0b-895b-4d5b-a9a4-ef5646040d20', 'name': 'network-vif-deleted', 'tag': 'a304cf63-faf2-4bfa-964d-9112da652ad0', 'status': 'completed', 'code': 200} Nov 11 14:28:49.641479 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:28:49.843520 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:49.870120 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:28:49.878224 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:28:49.878812 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:49.988764 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:28:50.018746 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dd4e0668-19d7-47db-9acf-cddf60ce983c req-a0d3a67d-68ec-4f28-b5d5-6112e3cc907b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdeccc0b-895b-4d5b-a9a4-ef5646040d20 HTTP/1.1" status: 200 len: 210 time: 0.0270073 Nov 11 14:28:50.194210 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:28:50.225836 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd47d48b-e265-4c16-bddb-fc24d60eb4f1 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:28:50.447654 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e461cd79-030d-4d17-9b1b-4970f9f4866a None None] New status for floating IP a694a2ce-d3e1-4299-958e-45c6bc8c4054: DOWN {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:28:51.282859 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-de89027b-3478-41c4-909f-a8478830f69c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1062906159&fields=id&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 267 time: 0.0432928 Nov 11 14:28:51.405946 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-c1ab49bc-0f7b-4111-91a2-fec2d203542f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:51.407451 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-c1ab49bc-0f7b-4111-91a2-fec2d203542f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1167974 Nov 11 14:28:51.422287 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-abb69047-0947-4994-82e2-b09c98e254d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/quotas/2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 375 time: 0.0086865 Nov 11 14:28:51.474986 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-57445fbb-0b36-43b9-bff6-3a501fe6ad99 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0466101 Nov 11 14:28:51.571282 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-31a26c3d-63ae-487d-be33-b5b099482397 service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826614 Nov 11 14:28:51.662115 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-03cad5ee-f072-4261-82da-a35fc9e04424 service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842738 Nov 11 14:28:52.167886 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b23c1d8b-8b50-4228-87a7-2f547c90949b req-ca81073a-c4b6-49a9-9203-46851bf828c1 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 210 time: 0.0262868 Nov 11 14:28:52.172607 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a304cf63-faf2-4bfa-964d-9112da652ad0 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:28:52.193502 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: a304cf63-faf2-4bfa-964d-9112da652ad0 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:28:52.193844 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a304cf63-faf2-4bfa-964d-9112da652ad0 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:28:53.260644 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2913661f-2a34-4f94-9884-4827476c393f req-da3edf64-b4a5-40be-95aa-d34dc3238a5f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 210 time: 0.0261948 Nov 11 14:28:54.102462 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-39ba0771-44e8-4930-897a-912b14e3dd2e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:54.103873 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-39ba0771-44e8-4930-897a-912b14e3dd2e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1049743 Nov 11 14:28:54.191202 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-7c838ed4-2cd5-4181-a58b-05031d20fc43 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 380 time: 0.0686784 Nov 11 14:28:54.203985 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'port': {'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'admin_state_up': True, 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'security_groups': ['2cfa354d-b685-49ff-add6-9fea82052f27']}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:28:54.359147 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e87311f7-e260-4b5a-945d-25b8e34575eb req-1fe0e519-3b2b-4df3-95bb-0eacbf01bd4f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 210 time: 0.0300310 Nov 11 14:28:54.369592 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Made reservation on behalf of 2d09ad6536ff49c4b4e43c8239742bc5 for: {'port': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:28:54.375677 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:54.512858 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.20.0.3 (4bad907f-fd8e-4849-9ded-63b7501aff2a/2b677022-3ca7-40d0-ba96-f88e6df9c517/b5393ed5-0b79-4d8b-a871-98e4a84d0246) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:28:54.658540 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:54.764970 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:54.801903 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:28:54.806920 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:28:54.809342 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:28:54.835393 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:54.866130 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:54.866836 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:54.932956 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-4043576e-c09a-42a5-b0ba-81322d2ed9db tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7326272 Nov 11 14:28:55.041000 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7b5a7620-b070-480e-8c7d-2766184fbbad None None] Provisioning complete for port b5393ed5-0b79-4d8b-a871-98e4a84d0246 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:28:55.041531 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7b5a7620-b070-480e-8c7d-2766184fbbad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.044143 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Request body: {'port': {'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:28:55.074442 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-7b5a7620-b070-480e-8c7d-2766184fbbad None None] Port b5393ed5-0b79-4d8b-a871-98e4a84d0246 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:28:55.102093 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.362548 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b5393ed5-0b79-4d8b-a871-98e4a84d0246 {{(pid=102268) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:28:55.370015 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.383498 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.provisioning_blocks [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Transition to ACTIVE for port object b5393ed5-0b79-4d8b-a871-98e4a84d0246 will not be triggered until provisioned by entity L2. {{(pid=102268) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:28:55.461897 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.502676 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea97ca23-7ca4-4473-bc2c-8896bd18cfc4 req-8b15e6c6-e600-4378-a7c6-84467613b832 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:55.504273 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ea97ca23-7ca4-4473-bc2c-8896bd18cfc4 req-8b15e6c6-e600-4378-a7c6-84467613b832 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 931 time: 0.0782719 Nov 11 14:28:55.538741 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Pushing event updated for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:55.613734 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ea97ca23-7ca4-4473-bc2c-8896bd18cfc4 req-e50fb7df-4aa0-45f2-9210-8713ab3f7cc0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1015029 Nov 11 14:28:55.635944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Attempting to bind port b5393ed5-0b79-4d8b-a871-98e4a84d0246 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:28:55.636273 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Attempting to bind port b5393ed5-0b79-4d8b-a871-98e4a84d0246 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:28:55.636594 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Attempting to bind port b5393ed5-0b79-4d8b-a871-98e4a84d0246 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:28:55.641031 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Port b5393ed5-0b79-4d8b-a871-98e4a84d0246 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:28:55.641338 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Attempting to bind port b5393ed5-0b79-4d8b-a871-98e4a84d0246 on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:28:55.647146 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 28, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:28:55.647542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:28:55.647913 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Bound using segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} {{(pid=102268) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:28:55.648328 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.managers [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Bound port: b5393ed5-0b79-4d8b-a871-98e4a84d0246, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}}] {{(pid=102268) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:28:55.648674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.715656 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, cleared binding levels {{(pid=102268) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:28:55.718447 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102268) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:28:55.827328 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.863232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:55.863864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:55.865798 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] 10.222.0.11 "PUT /v2.0/ports/b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 1093 time: 0.9218109 Nov 11 14:28:55.866231 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:55.868458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df960805-9d0f-4bcf-a895-9b553bdee838" -d '{"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:55.892266 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbb05ba-4f71-4286-9800-a57c3c7fa503 service neutron] Pushing event updated for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=3']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:56.048630 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-913a98ff-f4f1-45ab-a2eb-ae6930db188b x-openstack-request-id: req-913a98ff-f4f1-45ab-a2eb-ae6930db188b {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:56.048922 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:56.049170 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-913a98ff-f4f1-45ab-a2eb-ae6930db188b {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:56.049565 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'status': 'completed', 'code': 200} Nov 11 14:28:56.055832 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-b931e19a-b443-48be-b65a-bc61a6d6b2b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.057295 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-b931e19a-b443-48be-b65a-bc61a6d6b2b2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1096 time: 0.0495317 Nov 11 14:28:56.124902 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-2608a62c-3a45-42ae-8b15-44912d120ab4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 217 time: 0.0488384 Nov 11 14:28:56.206162 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-f8929ab2-b35e-49d5-98e0-5686541b5572 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.207640 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-f8929ab2-b35e-49d5-98e0-5686541b5572 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0696554 Nov 11 14:28:56.222097 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a123e-1c52-49fa-9c41-5591eb39e3ed req-72e871d1-d080-43e4-9c7c-413a7631b94d tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.223403 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9f5a123e-1c52-49fa-9c41-5591eb39e3ed req-72e871d1-d080-43e4-9c7c-413a7631b94d tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0780175 Nov 11 14:28:56.293766 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-5b65734e-ec4f-42f7-adb4-4fbebbf5500d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.295202 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-5b65734e-ec4f-42f7-adb4-4fbebbf5500d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0704098 Nov 11 14:28:56.298812 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9f5a123e-1c52-49fa-9c41-5591eb39e3ed req-22983647-90ab-4eaf-8ee6-f00014c2e021 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670745 Nov 11 14:28:56.386599 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-2cf5299c-0666-4a14-9052-35f711b56f61 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806003 Nov 11 14:28:56.479348 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1fac6423-d0db-4819-91a7-37321e3b2d97 req-d09b8551-4e3a-4206-b76f-32e1543546f9 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849259 Nov 11 14:28:56.630051 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-a488b39b-068e-4c50-9721-add4af158330 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.631561 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-a488b39b-068e-4c50-9721-add4af158330 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1096 time: 0.0406570 Nov 11 14:28:56.727856 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-c0d64a77-335d-42d4-b972-5b887d817187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.728125 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56b4a37-be29-42d0-8dbd-5c081b87854b req-a4a4095c-a54d-4cc8-b0fd-d977b573a77c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.729321 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-c0d64a77-335d-42d4-b972-5b887d817187 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.0881476 Nov 11 14:28:56.729641 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e56b4a37-be29-42d0-8dbd-5c081b87854b req-a4a4095c-a54d-4cc8-b0fd-d977b573a77c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0472827 Nov 11 14:28:56.774339 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-9320c937-cb7d-4cc5-b60b-1606097d552c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 217 time: 0.0350606 Nov 11 14:28:56.781681 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e56b4a37-be29-42d0-8dbd-5c081b87854b req-2cd08325-4e6c-4cda-afd5-6a5da06b9a8f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461149 Nov 11 14:28:56.828321 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-434650d6-e207-49cf-ad42-01bd03b2391b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.829825 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-434650d6-e207-49cf-ad42-01bd03b2391b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0436389 Nov 11 14:28:56.880319 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-589b193d-f6dc-4bb7-b206-3e78d87977db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:56.881735 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-589b193d-f6dc-4bb7-b206-3e78d87977db service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0385437 Nov 11 14:28:56.974897 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-f334a4fe-fadc-4545-8263-09bfd2654e48 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844476 Nov 11 14:28:57.069393 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-df960805-9d0f-4bcf-a895-9b553bdee838 req-667691ff-48fa-41cd-a902-267a16fc6ccb service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836318 Nov 11 14:28:57.410361 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43945d5f-6cb2-4cfc-b5d2-f840a4e662ec req-7b29e4f3-53b4-4ac2-abc8-a021947197b4 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:57.411827 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-43945d5f-6cb2-4cfc-b5d2-f840a4e662ec req-7b29e4f3-53b4-4ac2-abc8-a021947197b4 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0484242 Nov 11 14:28:57.458747 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-43945d5f-6cb2-4cfc-b5d2-f840a4e662ec req-608efbc5-d095-45f8-be47-1699f2a7d2a5 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402324 Nov 11 14:28:57.893042 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e51d6c2-a639-478a-b754-30f5855fc369 req-2468595e-8c51-4b6a-a009-1fe5eeff8fb6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:57.894502 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e51d6c2-a639-478a-b754-30f5855fc369 req-2468595e-8c51-4b6a-a009-1fe5eeff8fb6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0481005 Nov 11 14:28:57.943344 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e51d6c2-a639-478a-b754-30f5855fc369 req-3b77901c-7a7a-468a-8f7b-f60a320e24fb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427392 Nov 11 14:28:58.130250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-eef5b1a2-a356-4e97-afbe-3aaa06fbc0ca tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:58.131692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-eef5b1a2-a356-4e97-afbe-3aaa06fbc0ca tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 946 time: 0.0483685 Nov 11 14:28:58.226784 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Deleting port 5177a4d7-78e6-4641-b951-6a89c3c7e015 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:28:58.227105 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:58.313139 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] For port 5177a4d7-78e6-4641-b951-6a89c3c7e015, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5177a4d7-78e6-4641-b951-6a89c3c7e015,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:58.313487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:58.325427 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Calling delete_port for 5177a4d7-78e6-4641-b951-6a89c3c7e015 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:28:58.352670 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:28:58.501309 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:58.513310 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859', '71c0d0d0-62c4-4f55-bf50-79e7de51a062', '0d341f8a-67a3-484b-a551-ccfeea35a818', '5177a4d7-78e6-4641-b951-6a89c3c7e015'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:58.530192 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event deleted for resources: {'Port': ['ID=5177a4d7-78e6-4641-b951-6a89c3c7e015,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:58.568599 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b15fca44-416b-4214-885b-9ed7c16ff676 req-18588e6d-782c-4e9f-98c7-3f1e0faf0b8e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=a9793d7f-98bf-40b2-bfd4-912abad85342 HTTP/1.1" status: 200 len: 210 time: 0.0394597 Nov 11 14:28:58.569811 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.570159 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.570495 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.570826 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.571153 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.571506 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.572308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.572308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.572655 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.572847 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.573080 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.573401 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:28:58.616637 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] No DVR routers for this DVR port 5177a4d7-78e6-4641-b951-6a89c3c7e015 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:28:58.619081 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:58.623068 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-35cd4de0-8d6a-48ef-8fa6-e0571d505636 req-fedba621-5a14-49c5-9422-7d2241d9801a tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "DELETE /v2.0/ports/5177a4d7-78e6-4641-b951-6a89c3c7e015 HTTP/1.1" status: 204 len: 173 time: 0.4808011 Nov 11 14:28:58.623529 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'name': 'network-vif-deleted', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:58.626220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e817dc12-9b08-413d-9e7a-9c636c8a72a1" -d '{"events": [{"server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "name": "network-vif-deleted", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:58.662907 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7dbb731-7101-4bec-981b-13fe7ce3503a x-openstack-request-id: req-e7dbb731-7101-4bec-981b-13fe7ce3503a {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:58.663200 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9793d7f-98bf-40b2-bfd4-912abad85342", "name": "network-vif-deleted", "tag": "5177a4d7-78e6-4641-b951-6a89c3c7e015", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:58.663486 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-e7dbb731-7101-4bec-981b-13fe7ce3503a {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:58.664218 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9793d7f-98bf-40b2-bfd4-912abad85342', 'name': 'network-vif-deleted', 'tag': '5177a4d7-78e6-4641-b951-6a89c3c7e015', 'status': 'completed', 'code': 200} Nov 11 14:28:59.055196 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeacc48a-1e97-4a5b-83c3-5faca24a265a req-d1228f4c-b557-401b-a8c2-ce32699e1a21 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:59.056652 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-aeacc48a-1e97-4a5b-83c3-5faca24a265a req-d1228f4c-b557-401b-a8c2-ce32699e1a21 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0482042 Nov 11 14:28:59.104137 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-aeacc48a-1e97-4a5b-83c3-5faca24a265a req-1e278f1e-060c-41d2-b339-77e3ff28f74e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417194 Nov 11 14:28:59.349846 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-352dd728-ce9e-4678-af2f-c3e157fb2e24 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-43880818&fields=id&tenant_id=43dc465eb95943ee921d1e983a7e0320 HTTP/1.1" status: 200 len: 267 time: 0.0435722 Nov 11 14:28:59.401212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-53754b1e-d870-49a8-992e-8fbc7c5c16ae tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:59.402692 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-53754b1e-d870-49a8-992e-8fbc7c5c16ae tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 984 time: 0.0473797 Nov 11 14:28:59.414779 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Request body: {'port': {'security_groups': ['ca12ff19-a5ee-463e-88da-8321437b44a1']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:28:59.484522 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:59.659858 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:28:59.691157 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:59.735831 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:59.749612 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:59.798498 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:28:59.799060 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:59.802483 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-97957ff2-4b03-415f-bd1b-476cbcd1cf0d req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "PUT /v2.0/ports/c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 942 time: 0.3908093 Nov 11 14:28:59.802483 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:28:59.805519 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0335844f-2d4c-4b43-b2db-78ce71f22558" -d '{"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:28:59.809780 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36658) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:28:59.886441 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae1d705-0e50-4ee4-93de-a2103eb8595a tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event updated for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=7']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:28:59.900823 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:28:59.902890 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:28:59.916325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:28:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92443f5f-502c-4c86-92ea-ea4a43b3d7b0 x-openstack-request-id: req-92443f5f-502c-4c86-92ea-ea4a43b3d7b0 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:28:59.916934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:28:59.917386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-92443f5f-502c-4c86-92ea-ea4a43b3d7b0 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:28:59.917976 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:28:59.948376 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.032269 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-2bee53f7-7418-4032-8490-e6edf1ee022c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:00.034687 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-2bee53f7-7418-4032-8490-e6edf1ee022c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1098 time: 0.0824432 Nov 11 14:29:00.082648 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c78b7dd0-a300-4770-9ee5-f46ebce46dcf None None] Provisioning complete for port c53a8d64-6f5c-4000-90d7-691eb1341d9a triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:29:00.083461 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c78b7dd0-a300-4770-9ee5-f46ebce46dcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.144544 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-1eafcb1a-20f7-4e76-868c-fd03e15d11f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:00.147636 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-1eafcb1a-20f7-4e76-868c-fd03e15d11f9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 915 time: 0.1040568 Nov 11 14:29:00.209310 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.209310 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.209310 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "DELETE /v2.0/security-groups/a82016f9-d4d9-4029-9b9a-5e4865705f55 HTTP/1.1" status: 204 len: 168 time: 0.3964422 Nov 11 14:29:00.211300 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36668) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:00.226260 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92e65ae-2b4f-4748-a76e-462859e7b1ba tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a82016f9-d4d9-4029-9b9a-5e4865705f55,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:00.242203 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-740a94fd-ff6c-4e51-b22f-1e94ea012023 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 1000 time: 0.0856645 Nov 11 14:29:00.310699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-0c5b808c-05b9-4c5f-abcc-9d2f610f22c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:00.312593 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-0c5b808c-05b9-4c5f-abcc-9d2f610f22c3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.0545053 Nov 11 14:29:00.361617 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-4d2caff7-ef36-4187-b635-0fea075b2e43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:00.363409 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-4d2caff7-ef36-4187-b635-0fea075b2e43 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428762 Nov 11 14:29:00.376722 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d37272-7252-445e-a3cd-8fc15b8dc47a req-48cd47e3-1808-4afb-aefd-e25885bab94e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:00.378308 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-68d37272-7252-445e-a3cd-8fc15b8dc47a req-48cd47e3-1808-4afb-aefd-e25885bab94e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.1335597 Nov 11 14:29:00.462924 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-323c1e14-edfd-4b23-a799-4a41232ebb95 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887642 Nov 11 14:29:00.471001 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-68d37272-7252-445e-a3cd-8fc15b8dc47a req-ce85cc45-e037-484c-a83d-d80dd7dc858a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0856285 Nov 11 14:29:00.516032 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Deleting port cf2c1bf8-28ff-4b5f-8a94-885d5a64e255 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:00.516361 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.565396 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0335844f-2d4c-4b43-b2db-78ce71f22558 req-2871bef4-03e6-4e4f-a5c2-b09ede29e1ca service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891228 Nov 11 14:29:00.597826 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.598150 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.610249 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Calling delete_port for cf2c1bf8-28ff-4b5f-8a94-885d5a64e255 owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:00.884300 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.908638 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event deleted for resources: {'Port': ['ID=cf2c1bf8-28ff-4b5f-8a94-885d5a64e255,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:00.972546 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:00.972874 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Floating IP 8d72b67a-a52a-4baa-af67-c20f5a66879a disassociated (deleted). External IP: 172.27.1.69, port: c53a8d64-6f5c-4000-90d7-691eb1341d9a. Nov 11 14:29:01.175352 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Router fb1030fc-a673-40f8-8acc-5812ce724bec has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:01.309401 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3e6172-21d6-4486-88e8-cff8beeab8a7 req-b1101279-aaec-453c-b288-d12356fa9a06 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:01.310859 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-aa3e6172-21d6-4486-88e8-cff8beeab8a7 req-b1101279-aaec-453c-b288-d12356fa9a06 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.1217010 Nov 11 14:29:01.336350 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:01.341595 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:01.346242 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Sync routers for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:01.357605 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:01.358349 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:01.383554 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-50a89dcb-534b-42d9-97d9-059718fd53fa tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "DELETE /v2.0/floatingips/8d72b67a-a52a-4baa-af67-c20f5a66879a HTTP/1.1" status: 204 len: 168 time: 1.1685157 Nov 11 14:29:01.392750 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-aa3e6172-21d6-4486-88e8-cff8beeab8a7 req-2fcfe0f8-5b21-4d20-9f65-62b7c9391113 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750642 Nov 11 14:29:01.468413 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:01.585377 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94da2f5f-92bc-4986-8ad5-5f2e6cd2e74a req-be1c757d-38ec-4c4f-9efd-a14dc63a1fdb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:01.586862 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-94da2f5f-92bc-4986-8ad5-5f2e6cd2e74a req-be1c757d-38ec-4c4f-9efd-a14dc63a1fdb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0488877 Nov 11 14:29:01.635958 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-94da2f5f-92bc-4986-8ad5-5f2e6cd2e74a req-783f6f75-6e5d-4a3e-84f1-449c015e99e4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430083 Nov 11 14:29:01.671717 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:01.703839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Checking router: fb1030fc-a673-40f8-8acc-5812ce724bec for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:01.713057 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:01.713785 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:01.821713 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:01.919643 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:01.921880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a40ffac7-bf40-40ff-b400-ab94bc28cd49" -d '{"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:02.010927 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b832416-07e9-4595-81ea-c515f4928f10 x-openstack-request-id: req-9b832416-07e9-4595-81ea-c515f4928f10 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:02.011224 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:02.011503 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-9b832416-07e9-4595-81ea-c515f4928f10 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:02.011898 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:29:02.018133 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:02.051183 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4e8785f-3181-4619-9e84-8fee761a8a01 None None] The sync data for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi is: [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:26:01Z', 'revision_number': 4, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b97f6646-ee4c-4dac-9a61-7b951a205fbf', 'name': '', 'network_id': '974515c5-e282-45f9-84fa-971ce619e2ed', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'mac_address': 'fa:16:3e:12:14:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': '7c279c15-72b2-4ea5-aa18-273542134660', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:00Z', 'updated_at': '2021-11-11T14:26:05Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'subnets': [{'id': '7c279c15-72b2-4ea5-aa18-273542134660', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:02.238235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5177a4d7-78e6-4641-b951-6a89c3c7e015 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:02.268509 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 5177a4d7-78e6-4641-b951-6a89c3c7e015 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:02.269066 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5177a4d7-78e6-4641-b951-6a89c3c7e015 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:02.297946 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17e1bf45-e215-4efa-84b9-9121e15dcb09 None None] New status for floating IP 8d72b67a-a52a-4baa-af67-c20f5a66879a: DOWN {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:29:02.333241 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-67f13897-0d53-4dea-8277-8a1555a3354e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.334730 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-67f13897-0d53-4dea-8277-8a1555a3354e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=43dc465eb95943ee921d1e983a7e0320&device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 1098 time: 0.2921505 Nov 11 14:29:02.444777 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-1d38cca1-422c-4e39-82a4-8606f1da4d57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.446753 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-1d38cca1-422c-4e39-82a4-8606f1da4d57 service neutron] 10.222.0.11 "GET /v2.0/networks?id=974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 200 len: 915 time: 0.1001687 Nov 11 14:29:02.496736 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-2c902331-45b0-4ff0-8c07-56c8a3f43305 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 200 len: 217 time: 0.0399096 Nov 11 14:29:02.553436 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-faf53ca5-8552-48cb-a7e6-be982bb3a085 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.555011 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-faf53ca5-8552-48cb-a7e6-be982bb3a085 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 200 len: 853 time: 0.0494077 Nov 11 14:29:02.609909 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-39aa8ab4-de11-40a2-a2bd-f9fc1da826a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.612055 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-39aa8ab4-de11-40a2-a2bd-f9fc1da826a7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=974515c5-e282-45f9-84fa-971ce619e2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0465701 Nov 11 14:29:02.736066 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32945fc-e818-4ec5-9719-0e37a42a0989 req-17c4b826-bb69-4df8-9b09-fbdedd138831 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.738867 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-2b8aa4f5-5ea1-4d34-8fe8-048b551b9c6e service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1124680 Nov 11 14:29:02.739626 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d32945fc-e818-4ec5-9719-0e37a42a0989 req-17c4b826-bb69-4df8-9b09-fbdedd138831 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.2709374 Nov 11 14:29:02.789237 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d32945fc-e818-4ec5-9719-0e37a42a0989 req-154f91cc-4b2c-4831-aef0-c534566e10ec tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435684 Nov 11 14:29:02.796279 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97270f1b-9521-40ec-9a09-a09d039997b6 req-1946e059-f794-40fd-8770-b5897d146dac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.799979 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-97270f1b-9521-40ec-9a09-a09d039997b6 req-1946e059-f794-40fd-8770-b5897d146dac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0803871 Nov 11 14:29:02.891516 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2410c41d-55c4-4330-9695-f3a98a78ece2 req-bd70e692-ca9a-41cb-8254-6a4b327489ad tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:02.893133 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2410c41d-55c4-4330-9695-f3a98a78ece2 req-bd70e692-ca9a-41cb-8254-6a4b327489ad tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0479658 Nov 11 14:29:02.913011 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a40ffac7-bf40-40ff-b400-ab94bc28cd49 req-e4e02129-2b01-4565-89f2-cb0156f3b952 service neutron] 10.222.0.11 "GET /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1501451 Nov 11 14:29:02.917264 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-97270f1b-9521-40ec-9a09-a09d039997b6 req-80146e04-377f-4f8c-aec3-f4deb3af131d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0706789 Nov 11 14:29:02.956675 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2410c41d-55c4-4330-9695-f3a98a78ece2 req-abaac1fe-0c26-4f4c-b86e-a5df3d1bb6cb tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566440 Nov 11 14:29:03.094125 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-ef1ca9e3-0345-453e-980f-3594a9bc53c3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:03.095630 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-ef1ca9e3-0345-453e-980f-3594a9bc53c3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 945 time: 0.0488875 Nov 11 14:29:03.189517 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Deleting port 0d341f8a-67a3-484b-a551-ccfeea35a818 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:03.189847 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:03.284139 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] For port 0d341f8a-67a3-484b-a551-ccfeea35a818, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0d341f8a-67a3-484b-a551-ccfeea35a818,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:03.293083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:03.297398 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Calling delete_port for 0d341f8a-67a3-484b-a551-ccfeea35a818 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:03.506570 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:03.518168 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859', '71c0d0d0-62c4-4f55-bf50-79e7de51a062', '0d341f8a-67a3-484b-a551-ccfeea35a818'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:03.534919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event deleted for resources: {'Port': ['ID=0d341f8a-67a3-484b-a551-ccfeea35a818,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:03.578389 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] No DVR routers for this DVR port 0d341f8a-67a3-484b-a551-ccfeea35a818 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:03.580860 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:03.584877 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-617aa808-9f23-473e-9bde-3f0646b5a16d req-d49087b6-8f91-4173-bcf0-526a774e0a6e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "DELETE /v2.0/ports/0d341f8a-67a3-484b-a551-ccfeea35a818 HTTP/1.1" status: 204 len: 173 time: 0.4831269 Nov 11 14:29:03.585330 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'name': 'network-vif-deleted', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:03.587595 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-552d447c-922a-43fa-8c8a-351a91dfbf80" -d '{"events": [{"server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "name": "network-vif-deleted", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:03.624065 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-21d5e71d-b3f9-4a9f-89e7-cef10547c583 x-openstack-request-id: req-21d5e71d-b3f9-4a9f-89e7-cef10547c583 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:03.628092 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "232240b0-dbad-4c8f-b62d-9a8126f0dc69", "name": "network-vif-deleted", "tag": "0d341f8a-67a3-484b-a551-ccfeea35a818", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:03.628092 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-21d5e71d-b3f9-4a9f-89e7-cef10547c583 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:03.628092 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '232240b0-dbad-4c8f-b62d-9a8126f0dc69', 'name': 'network-vif-deleted', 'tag': '0d341f8a-67a3-484b-a551-ccfeea35a818', 'status': 'completed', 'code': 200} Nov 11 14:29:03.899593 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8f1127cd-4e4d-42d5-b1bf-ab0a1765bb13 req-344ce574-9454-4236-99a0-046eadc337d2 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=232240b0-dbad-4c8f-b62d-9a8126f0dc69 HTTP/1.1" status: 200 len: 210 time: 0.0257452 Nov 11 14:29:04.047668 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927b5ad7-f176-4e65-9c23-f00de575a555 req-379f4840-41de-4d25-9b93-4f53f8c514e8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:04.049125 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-927b5ad7-f176-4e65-9c23-f00de575a555 req-379f4840-41de-4d25-9b93-4f53f8c514e8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0491204 Nov 11 14:29:04.070435 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e6d561-4951-4ffc-9ce8-ddf95f66f449 req-aab446fb-1576-4399-b7e4-03d3d1299909 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:04.071974 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12e6d561-4951-4ffc-9ce8-ddf95f66f449 req-aab446fb-1576-4399-b7e4-03d3d1299909 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 943 time: 0.0517485 Nov 11 14:29:04.098216 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-927b5ad7-f176-4e65-9c23-f00de575a555 req-591bfdaa-b0b2-402c-b406-10ef9046d8dc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=5d4b747c-5f16-473b-94d6-7b2f069d85b1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430677 Nov 11 14:29:04.124954 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12e6d561-4951-4ffc-9ce8-ddf95f66f449 req-826e50b3-aa7b-44a7-b82b-adcc78fb712a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470760 Nov 11 14:29:04.247705 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device b5393ed5-0b79-4d8b-a871-98e4a84d0246 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:29:04.352898 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:04.361918 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18611066-a3c7-407c-9e44-166fb52550ad req-813c917f-a3a0-46df-977d-feccec4d1ce8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:04.364095 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-18611066-a3c7-407c-9e44-166fb52550ad req-813c917f-a3a0-46df-977d-feccec4d1ce8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 946 time: 0.0556986 Nov 11 14:29:04.365144 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:29:04.417791 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.431899 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b5393ed5-0b79-4d8b-a871-98e4a84d0246 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:29:04.451501 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:04.495149 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Deleting port 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:04.495513 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.558295 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.585552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] For port 4c18064d-696c-4c89-af13-19525b371b78, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4c18064d-696c-4c89-af13-19525b371b78,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:04.586100 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.609653 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:04.772353 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.772708 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:04.773036 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Floating IP b076f550-5146-4a27-bb0d-501417a8b48e disassociated. External IP: 172.27.1.140, port: 4c18064d-696c-4c89-af13-19525b371b78. Nov 11 14:29:04.773358 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Calling delete_port for 4c18064d-696c-4c89-af13-19525b371b78 owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:04.776621 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee838bf0-e554-48b3-b9ad-4604c74ff4b9 req-920789b3-4c4e-4c65-95f6-aea1d5917480 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:04.778660 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ee838bf0-e554-48b3-b9ad-4604c74ff4b9 req-920789b3-4c4e-4c65-95f6-aea1d5917480 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0497508 Nov 11 14:29:04.799581 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['b5393ed5-0b79-4d8b-a871-98e4a84d0246'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:04.833206 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ee838bf0-e554-48b3-b9ad-4604c74ff4b9 req-d15eec72-9ea7-434a-a58e-040b11b39c7d tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482516 Nov 11 14:29:04.975808 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:05.012468 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'Port': ['ID=4c18064d-696c-4c89-af13-19525b371b78,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:05.148160 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:05.224914 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3bb24388-34d7-4c89-9ddf-b0da2583c31c req-19db606a-689d-4cab-b409-de5b3ea42f08 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.0318570 Nov 11 14:29:05.289534 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:05.301770 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:05.313839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:05.315344 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:05.350996 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] No DVR routers for this DVR port 4c18064d-696c-4c89-af13-19525b371b78 on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:05.354747 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:05.358784 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-18611066-a3c7-407c-9e44-166fb52550ad req-36e9a11a-1174-432b-b397-9df8e06fc399 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "DELETE /v2.0/ports/4c18064d-696c-4c89-af13-19525b371b78 HTTP/1.1" status: 204 len: 173 time: 0.9862380 Nov 11 14:29:05.379611 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f9bb44-97eb-4157-892c-33c10b188283 req-e383b97f-68ce-4ac0-a29f-aa5a2b0203da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:05.381884 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-13f9bb44-97eb-4157-892c-33c10b188283 req-e383b97f-68ce-4ac0-a29f-aa5a2b0203da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0588281 Nov 11 14:29:05.384556 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f75e848-7aba-4bed-ad99-1a18d2810801 req-8efbe964-b962-4174-91a7-552dca234449 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:05.386173 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f75e848-7aba-4bed-ad99-1a18d2810801 req-8efbe964-b962-4174-91a7-552dca234449 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 944 time: 0.0901053 Nov 11 14:29:05.460378 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0f75e848-7aba-4bed-ad99-1a18d2810801 req-c6935357-0dd6-4683-87a6-213c62a6290a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623314 Nov 11 14:29:05.460509 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:05.460884 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-13f9bb44-97eb-4157-892c-33c10b188283 req-55783c54-4a8c-4455-bd30-914b425dad52 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710690 Nov 11 14:29:05.626178 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-deleted', 'tag': '4c18064d-696c-4c89-af13-19525b371b78'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:05.628512 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02e5c0dc-cb9c-47c6-b0d8-63960caf2c27" -d '{"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-deleted", "tag": "4c18064d-696c-4c89-af13-19525b371b78"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:05.663808 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60ce612f-3d8a-4114-881d-d0a93baca9c5 x-openstack-request-id: req-60ce612f-3d8a-4114-881d-d0a93baca9c5 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:05.664096 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1a0df48-fcb8-409b-abc6-a7d60578b805", "name": "network-vif-deleted", "tag": "4c18064d-696c-4c89-af13-19525b371b78", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:05.664348 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-60ce612f-3d8a-4114-881d-d0a93baca9c5 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:05.664798 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a0df48-fcb8-409b-abc6-a7d60578b805', 'name': 'network-vif-deleted', 'tag': '4c18064d-696c-4c89-af13-19525b371b78', 'status': 'completed', 'code': 200} Nov 11 14:29:05.674597 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:05.700988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:05.709783 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:05.710386 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:28:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:05.813356 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:05.955040 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1b3316-1c20-4b76-962c-d96e5ad1a36a req-d3acd4cd-61f2-468c-9078-28633db9edaf tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:05.956545 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cb1b3316-1c20-4b76-962c-d96e5ad1a36a req-d3acd4cd-61f2-468c-9078-28633db9edaf tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0484459 Nov 11 14:29:06.006213 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cb1b3316-1c20-4b76-962c-d96e5ad1a36a req-0edebe0a-6284-4dd1-8727-934c19faf564 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/security-groups?id=ca12ff19-a5ee-463e-88da-8321437b44a1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414455 Nov 11 14:29:06.030367 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:06.057373 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f54d45f-3af3-4e58-bff1-bcf90bbd3ad8 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:06.072124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-060d74bd-daac-49af-9a7d-f0c8361df06b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.254683 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device b5393ed5-0b79-4d8b-a871-98e4a84d0246 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:29:06.264536 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-514e988c-ba83-41a7-90a9-5dc3d567c66b None None] New status for floating IP b076f550-5146-4a27-bb0d-501417a8b48e: DOWN {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:29:06.357116 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f9cd0758-10d0-458a-8495-f499a6eab684 req-092e18e3-8d02-48bf-b900-4d5dbfc67912 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=e1a0df48-fcb8-409b-abc6-a7d60578b805 HTTP/1.1" status: 200 len: 210 time: 0.0312316 Nov 11 14:29:06.386100 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port b5393ed5-0b79-4d8b-a871-98e4a84d0246 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:29:06.390107 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port b5393ed5-0b79-4d8b-a871-98e4a84d0246 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:29:06.390472 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.471218 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.497185 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:06.499268 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b67f541a-f171-42d8-96b7-20cee07bc6ba" -d '{"events": [{"server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "name": "network-vif-plugged", "status": "completed", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:06.512595 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:06.548046 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-54ef4b52-b51c-4e60-877b-938c3b18b3d3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:06.549628 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-54ef4b52-b51c-4e60-877b-938c3b18b3d3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.11 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 945 time: 0.0751729 Nov 11 14:29:06.581264 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.582134 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:06.611280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2039b1bd-5fa8-4ad0-a690-980299fed537 req-92833c7d-e176-4f86-8542-a912015c03ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:06.613423 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2039b1bd-5fa8-4ad0-a690-980299fed537 req-92833c7d-e176-4f86-8542-a912015c03ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 944 time: 0.0653627 Nov 11 14:29:06.622073 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 4c18064d-696c-4c89-af13-19525b371b78 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:06.622405 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4c18064d-696c-4c89-af13-19525b371b78 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:06.622823 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0d341f8a-67a3-484b-a551-ccfeea35a818 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:06.631484 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f54c36-8cfb-4937-bbc0-b160686ab5ab req-90e12123-715a-48ab-82e5-8df3d603e957 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:06.632977 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-93f54c36-8cfb-4937-bbc0-b160686ab5ab req-90e12123-715a-48ab-82e5-8df3d603e957 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0796771 Nov 11 14:29:06.650391 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 0d341f8a-67a3-484b-a551-ccfeea35a818 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:06.650948 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0d341f8a-67a3-484b-a551-ccfeea35a818 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:06.674060 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2039b1bd-5fa8-4ad0-a690-980299fed537 req-09252027-c892-4ed3-adaa-0845205e19c5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533817 Nov 11 14:29:06.675418 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:06.720064 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-93f54c36-8cfb-4937-bbc0-b160686ab5ab req-8a9eced5-2a2e-4449-9e46-01003e8fe264 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618343 Nov 11 14:29:06.728085 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Deleting port c53a8d64-6f5c-4000-90d7-691eb1341d9a {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:06.728418 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.743637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96830958-746a-4e33-ad0e-6fb33f12af83 x-openstack-request-id: req-96830958-746a-4e33-ad0e-6fb33f12af83 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:06.743637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "name": "network-vif-plugged", "status": "completed", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:06.743637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-96830958-746a-4e33-ad0e-6fb33f12af83 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:06.743637 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'code': 200} Nov 11 14:29:06.749147 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-9fa893fc-a0a9-45a0-abc6-325509c884b3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:06.750842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-9fa893fc-a0a9-45a0-abc6-325509c884b3 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 946 time: 0.0606070 Nov 11 14:29:06.822537 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] For port c53a8d64-6f5c-4000-90d7-691eb1341d9a, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=c53a8d64-6f5c-4000-90d7-691eb1341d9a,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:06.822896 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.848864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Calling delete_port for c53a8d64-6f5c-4000-90d7-691eb1341d9a owned by compute:nova {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:06.851118 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Deleting port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:06.851483 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.942637 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] For port 71c0d0d0-62c4-4f55-bf50-79e7de51a062, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=71c0d0d0-62c4-4f55-bf50-79e7de51a062,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:06.943082 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:06.955864 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Calling delete_port for 71c0d0d0-62c4-4f55-bf50-79e7de51a062 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:07.044261 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.057992 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['c53a8d64-6f5c-4000-90d7-691eb1341d9a'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:07.075595 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Pushing event deleted for resources: {'Port': ['ID=c53a8d64-6f5c-4000-90d7-691eb1341d9a,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:07.126422 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] No DVR routers for this DVR port c53a8d64-6f5c-4000-90d7-691eb1341d9a on host hv-cinder-77703 {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:07.128872 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.132721 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.11 "DELETE /v2.0/ports/c53a8d64-6f5c-4000-90d7-691eb1341d9a HTTP/1.1" status: 204 len: 173 time: 0.5710456 Nov 11 14:29:07.135152 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-171cd65c-d43b-48db-926b-ef088078c471 req-15c118c3-8e5b-4814-86cb-1c6e4e1e746b tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 210 time: 0.0405726 Nov 11 14:29:07.148476 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0d0aa5-f13d-444c-acdd-efe981fcf8a6 req-91c5bd0d-96cd-4a43-9e6d-af2116af7965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:07.151717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a0d0aa5-f13d-444c-acdd-efe981fcf8a6 req-91c5bd0d-96cd-4a43-9e6d-af2116af7965 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1098 time: 0.0876634 Nov 11 14:29:07.196133 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a0d0aa5-f13d-444c-acdd-efe981fcf8a6 req-c939982d-6159-4d98-b513-cfda459f8b55 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388379 Nov 11 14:29:07.209576 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.220282 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859', '71c0d0d0-62c4-4f55-bf50-79e7de51a062'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:07.237748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event deleted for resources: {'Port': ['ID=71c0d0d0-62c4-4f55-bf50-79e7de51a062,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:07.280329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] No DVR routers for this DVR port 71c0d0d0-62c4-4f55-bf50-79e7de51a062 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:07.282731 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.286143 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b9d2e73d-5bd7-4cc1-b788-aa327d10e44a req-1e38494d-1c6c-410e-8da2-5ff432f1a508 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "DELETE /v2.0/ports/71c0d0d0-62c4-4f55-bf50-79e7de51a062 HTTP/1.1" status: 204 len: 173 time: 0.5286102 Nov 11 14:29:07.286584 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'name': 'network-vif-deleted', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:07.288877 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-392676c4-f930-41f2-b9be-e70e12242315" -d '{"events": [{"server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "name": "network-vif-deleted", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:07.324942 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55738640-6c7c-4174-8f0f-8157d3d8c54f x-openstack-request-id: req-55738640-6c7c-4174-8f0f-8157d3d8c54f {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:07.325233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94f4da16-f30f-4eac-80b0-8f1cf43698f6", "name": "network-vif-deleted", "tag": "71c0d0d0-62c4-4f55-bf50-79e7de51a062", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:07.325486 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-55738640-6c7c-4174-8f0f-8157d3d8c54f {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:07.326244 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94f4da16-f30f-4eac-80b0-8f1cf43698f6', 'name': 'network-vif-deleted', 'tag': '71c0d0d0-62c4-4f55-bf50-79e7de51a062', 'status': 'completed', 'code': 200} Nov 11 14:29:07.560516 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36758) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:07.615276 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.638049 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.665847 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'name': 'network-vif-deleted', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:07.668205 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb6662d9-1af5-4063-a390-b72fa96ca8cf" -d '{"events": [{"server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "name": "network-vif-deleted", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:07.703078 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7546baf1-f8d0-4a09-b20b-048f7fb82cdc x-openstack-request-id: req-7546baf1-f8d0-4a09-b20b-048f7fb82cdc {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:07.703343 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0a7090f-ecbd-463d-b458-d6106af7cf0e", "name": "network-vif-deleted", "tag": "c53a8d64-6f5c-4000-90d7-691eb1341d9a", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:07.703616 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-7546baf1-f8d0-4a09-b20b-048f7fb82cdc {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:07.704004 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0a7090f-ecbd-463d-b458-d6106af7cf0e', 'name': 'network-vif-deleted', 'tag': 'c53a8d64-6f5c-4000-90d7-691eb1341d9a', 'status': 'completed', 'code': 200} Nov 11 14:29:07.762776 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.765436 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:07.766583 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "DELETE /v2.0/security-groups/5d4b747c-5f16-473b-94d6-7b2f069d85b1 HTTP/1.1" status: 204 len: 168 time: 0.2047899 Nov 11 14:29:07.769804 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36766) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:07.783326 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e63ad3c9-fd9f-42a2-a27c-30ecaf39de19 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d4b747c-5f16-473b-94d6-7b2f069d85b1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:07.790494 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.api.v2.resource [None req-a7896af5-c82a-4c88-817e-d8f98ece501b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] show failed (client error): The resource could not be found. Nov 11 14:29:07.791545 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a7896af5-c82a-4c88-817e-d8f98ece501b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups/5d4b747c-5f16-473b-94d6-7b2f069d85b1 HTTP/1.1" status: 404 len: 347 time: 0.0194068 Nov 11 14:29:07.795841 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36768) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:07.809688 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc8e9bb-cd01-4cfd-b6f0-eaf3c94caff3 req-45a24d1f-04c5-4c52-8bdd-9403e5929fd6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:07.809688 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0dc8e9bb-cd01-4cfd-b6f0-eaf3c94caff3 req-45a24d1f-04c5-4c52-8bdd-9403e5929fd6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0645888 Nov 11 14:29:07.860975 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0dc8e9bb-cd01-4cfd-b6f0-eaf3c94caff3 req-9d1acf38-7e99-45ec-874a-e3a96f17f0e7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461233 Nov 11 14:29:07.873769 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-35af7f60-b942-45fa-8acd-f1f43e684d80 req-3bebfb8f-e75e-4115-bca6-29a1d1d86a34 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=94f4da16-f30f-4eac-80b0-8f1cf43698f6 HTTP/1.1" status: 200 len: 210 time: 0.0579090 Nov 11 14:29:07.957983 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Deleting port 523729a1-3191-4d9c-85dd-7a9155ac641b {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:07.958329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.031213 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.031568 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.043259 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Calling delete_port for 523729a1-3191-4d9c-85dd-7a9155ac641b owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:08.254974 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-05a416af-7f57-48ac-8205-65f2f493c527 req-ff8ccd88-1c79-4342-9fa4-6f29a5a3bdf3 tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0a7090f-ecbd-463d-b458-d6106af7cf0e HTTP/1.1" status: 200 len: 210 time: 0.0297444 Nov 11 14:29:08.261297 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.288313 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'Port': ['ID=523729a1-3191-4d9c-85dd-7a9155ac641b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:08.349700 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.352177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.353341 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1bf8decc-6ddd-4f14-aa2d-3b4949aff049 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "DELETE /v2.0/floatingips/b076f550-5146-4a27-bb0d-501417a8b48e HTTP/1.1" status: 204 len: 168 time: 0.5557408 Nov 11 14:29:08.490112 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-49b24481-2e71-4b97-b170-a03ded3eb63b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.711356 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36774) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:08.715936 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1916645205', 'description': 'tempest-description--1069336249'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:08.809931 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.878979 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.924004 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:08.985238 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroup': ['ID=15693065-525e-45e8-892f-4923e0104538,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:09.002320 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020b83bc-1c9e-40e6-abda-b45ee0bb4a89 req-81a9dd69-bd06-445b-9279-49a0e0762117 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:09.003798 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-020b83bc-1c9e-40e6-abda-b45ee0bb4a89 req-81a9dd69-bd06-445b-9279-49a0e0762117 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0702829 Nov 11 14:29:09.037241 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.038390 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-64f1dec2-e0e7-4184-b2c6-781a5c1e745a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.3259938 Nov 11 14:29:09.045617 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36782) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:09.050710 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group_rule': {'security_group_id': '15693065-525e-45e8-892f-4923e0104538', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:09.056999 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-020b83bc-1c9e-40e6-abda-b45ee0bb4a89 req-b83811c0-2677-417c-8c5b-49885789348a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473015 Nov 11 14:29:09.168700 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.199289 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56347bc-7423-4403-bd06-9adebf3291cc req-f9e7f7cc-8d65-4036-a41e-8aa0b1594d3c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:09.200771 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b56347bc-7423-4403-bd06-9adebf3291cc req-f9e7f7cc-8d65-4036-a41e-8aa0b1594d3c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0705154 Nov 11 14:29:09.251749 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.267814 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b56347bc-7423-4403-bd06-9adebf3291cc req-89b32406-4b59-4a66-ab90-f84255597914 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602448 Nov 11 14:29:09.294123 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36790) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:09.320413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.348432 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e6523d8-65c5-4371-b9aa-603c7ffcfa48,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:09.356201 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-949c8c69-3866-4c1f-9c8a-fbed20d3c822 tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:09.357701 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-949c8c69-3866-4c1f-9c8a-fbed20d3c822 tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1093 time: 0.0625908 Nov 11 14:29:09.360416 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36794) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:09.364593 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:09.424863 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.426116 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1c47f12d-40ef-45e8-bd62-a1e469f8eecb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3788571 Nov 11 14:29:09.429549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36800) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:09.434699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'security_group_rule': {'security_group_id': '15693065-525e-45e8-892f-4923e0104538', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:09.530248 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.631049 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.633854 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.639386 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.686763 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.740425 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.27.1.108 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:29:09.752298 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.771251 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37d4ef9f-62e7-408e-bca1-89a82d4bd965,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:09.852089 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.866839 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.866839 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-885a9d81-29d2-43c1-9855-144bd87ddd63 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4338951 Nov 11 14:29:09.867604 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36824) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:09.872092 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:09.952773 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.967345 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:09.998744 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:29:10.001696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:29:10.006105 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:29:10.009194 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:10.076513 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.184441 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Allocated IP 172.27.1.86 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/878612e3-22c7-4877-81bf-3281de2585fa) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:29:10.287251 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 71c0d0d0-62c4-4f55-bf50-79e7de51a062 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:10.308301 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.308531 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 71c0d0d0-62c4-4f55-bf50-79e7de51a062 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:10.308764 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 71c0d0d0-62c4-4f55-bf50-79e7de51a062 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:10.309367 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device c53a8d64-6f5c-4000-90d7-691eb1341d9a no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:10.328370 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: c53a8d64-6f5c-4000-90d7-691eb1341d9a {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:10.328705 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device c53a8d64-6f5c-4000-90d7-691eb1341d9a not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:10.385699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.433060 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.473898 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:29:10.478680 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:29:10.481096 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:29:10.508961 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=878612e3-22c7-4877-81bf-3281de2585fa,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:10.523634 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.585711 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.683890 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ebeaab8-4247-4637-9390-8af311c169a3 req-82115102-483a-401c-b963-79e9d7388260 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:10.685388 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6ebeaab8-4247-4637-9390-8af311c169a3 req-82115102-483a-401c-b963-79e9d7388260 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.0909200 Nov 11 14:29:10.697751 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.755117 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.760742 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6ebeaab8-4247-4637-9390-8af311c169a3 req-c81385ca-6f56-4693-abbf-841506c4a2c0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645082 Nov 11 14:29:10.763931 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.838348 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.850275 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.912036 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:10.922930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.935393 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:10.956053 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36850) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:11.007063 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=878612e3-22c7-4877-81bf-3281de2585fa,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:11.021044 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:11.096928 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:11.098170 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-efbb847f-32f0-4d1e-8d58-f34d2a4596c8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2295549 Nov 11 14:29:11.108614 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP 310ebba1-233e-43f6-9a3c-4d5402f5ba23 associated. External IP: 172.27.1.108, port: b5393ed5-0b79-4d8b-a871-98e4a84d0246. Nov 11 14:29:11.292805 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-44a041f6-207e-45e2-ad88-e97f8df57c11 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-securitygroup--1916645205&fields=id&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 267 time: 0.0423377 Nov 11 14:29:11.407248 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-edb01a9e-24d1-4418-9125-688c0cd39152 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:11.408827 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-edb01a9e-24d1-4418-9125-688c0cd39152 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 817 time: 0.1093147 Nov 11 14:29:11.425094 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-c41734da-2cab-4669-800b-20060f7816ec tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/quotas/b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 375 time: 0.0097892 Nov 11 14:29:11.483358 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-254b06df-f0f8-4857-b4fb-6ec5a6500f78 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0519607 Nov 11 14:29:11.585407 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-d4b87154-e502-47b2-940a-3bdf19d1b611 service neutron] 10.222.0.10 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898142 Nov 11 14:29:11.676278 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-a43cb850-8210-4b5d-ba0b-a4390ea1b411 service neutron] 10.222.0.10 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846958 Nov 11 14:29:11.689618 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:11.705570 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:11.919463 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ce5ffc2a-98ca-4fe0-a593-051c04d210e8 req-e10cb448-d759-4844-8902-1671ed93c5a4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 210 time: 0.0316870 Nov 11 14:29:11.936971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:11.950536 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:11.956900 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:11.965862 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a18993-ad35-4e97-a4e9-f78f3cf6e8de req-cbf4e3ea-c9b0-4ab4-8541-506d8fd27a2e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:11.972187 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-93a18993-ad35-4e97-a4e9-f78f3cf6e8de req-cbf4e3ea-c9b0-4ab4-8541-506d8fd27a2e tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.1159956 Nov 11 14:29:11.974966 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:11.975636 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:12.101132 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:12.104711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.134019 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.137024 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-93a18993-ad35-4e97-a4e9-f78f3cf6e8de req-c6530957-76e1-4426-9e02-1a20d991554b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348608 Nov 11 14:29:12.174649 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-565c6ecd-bdab-4bd7-9a30-58041a005f7c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8132339 Nov 11 14:29:12.206846 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:12.210246 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92" -d '{"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:12.223241 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3590b033-6d83-4935-aabc-b370294918fe req-6c43d136-fa8c-4904-9c69-25fd9fe5273b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:12.224648 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3590b033-6d83-4935-aabc-b370294918fe req-6c43d136-fa8c-4904-9c69-25fd9fe5273b tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.1662891 Nov 11 14:29:12.288657 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-638f7f62-1180-4b77-b62e-77ecd4d55edc x-openstack-request-id: req-638f7f62-1180-4b77-b62e-77ecd4d55edc {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:12.288986 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:12.289185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-638f7f62-1180-4b77-b62e-77ecd4d55edc {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:12.289580 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'status': 'completed', 'code': 200} Nov 11 14:29:12.354928 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:10Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:12.384303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:12.393104 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:12.393705 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:12.404063 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-411722c5-9300-48dc-9549-58b026348039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:12.405557 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-411722c5-9300-48dc-9549-58b026348039 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1098 time: 0.1038074 Nov 11 14:29:12.465516 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Deleting port 6f453929-a95f-4aeb-83e9-5b8a818d9859 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:12.465860 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.498329 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:12.633736 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-605c95fe-c947-4875-a4b1-c859e77846ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:12.635238 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-605c95fe-c947-4875-a4b1-c859e77846ef service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.2205160 Nov 11 14:29:12.637003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] For port 6f453929-a95f-4aeb-83e9-5b8a818d9859, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=6f453929-a95f-4aeb-83e9-5b8a818d9859,segment=NetworkSegment(a261d729-bba1-440e-ba21-5fcca20345f3),segment_id=a261d729-bba1-440e-ba21-5fcca20345f3)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:12.637377 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.663476 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Calling delete_port for 6f453929-a95f-4aeb-83e9-5b8a818d9859 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:12.701619 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Deleting port b97f6646-ee4c-4dac-9a61-7b951a205fbf {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:12.701993 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.814502 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-0be06a47-da1c-4bed-ba58-16340338be31 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 999 time: 0.1685026 Nov 11 14:29:12.848880 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:10Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:12.874442 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8880af-b091-4d02-a399-84bcb00b0cb4 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:10Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:12.887635 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] For port b97f6646-ee4c-4dac-9a61-7b951a205fbf, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b97f6646-ee4c-4dac-9a61-7b951a205fbf,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:12.887910 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:12.914890 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Calling delete_port for b97f6646-ee4c-4dac-9a61-7b951a205fbf owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:12.920730 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-87d4c5ec-f5e8-42c2-9fba-6d4303a6e870 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:12.922208 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-87d4c5ec-f5e8-42c2-9fba-6d4303a6e870 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0986636 Nov 11 14:29:13.110540 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3937501-07de-40bc-a9be-749eeaa3d0be None None] New status for floating IP 310ebba1-233e-43f6-9a3c-4d5402f5ba23: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:29:13.276437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650ee074-de4e-43f1-bc33-cdb682222be1 req-e7202bbd-a202-4d34-9abe-f3bea51b3487 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:13.278983 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-650ee074-de4e-43f1-bc33-cdb682222be1 req-e7202bbd-a202-4d34-9abe-f3bea51b3487 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 946 time: 0.0544064 Nov 11 14:29:13.280341 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bc61aef3-61ec-4116-97ab-af516e06e59a req-70b642ba-cc63-4231-8d48-9c261d701cd3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 210 time: 0.2721696 Nov 11 14:29:13.322187 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-d69befe4-f0d6-426a-b529-e69fd501569b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:13.325682 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-d69befe4-f0d6-426a-b529-e69fd501569b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3915060 Nov 11 14:29:13.348332 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-650ee074-de4e-43f1-bc33-cdb682222be1 req-3f806507-7434-48dc-9116-2941bfb6b0da tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/security-groups?id=87303888-f648-400d-a8a2-f70720c6963f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534487 Nov 11 14:29:13.372219 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:13.384122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['6f453929-a95f-4aeb-83e9-5b8a818d9859'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:13.434856 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Pushing event deleted for resources: {'Port': ['ID=6f453929-a95f-4aeb-83e9-5b8a818d9859,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:13.525811 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] No DVR routers for this DVR port 6f453929-a95f-4aeb-83e9-5b8a818d9859 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:13.528353 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:13.531722 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3590b033-6d83-4935-aabc-b370294918fe req-2b94c22d-1654-400b-97d2-6b70c65f4ec0 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.11 "DELETE /v2.0/ports/6f453929-a95f-4aeb-83e9-5b8a818d9859 HTTP/1.1" status: 204 len: 173 time: 1.2910624 Nov 11 14:29:13.583907 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-ced0b609-93bd-430c-a97d-8e15ba8506e2 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2237761 Nov 11 14:29:13.681070 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6d3fa3fa-c533-4804-ab68-a8d92e9d5e92 req-ab2f5b12-f5ba-4b82-aa88-68ccb9184b5f service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898726 Nov 11 14:29:13.706772 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:13.763024 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Pushing event deleted for resources: {'Port': ['ID=b97f6646-ee4c-4dac-9a61-7b951a205fbf,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:13.917939 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-6d104bfc-903c-4ac3-a74b-4406f67ad298 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:13.919446 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-6d104bfc-903c-4ac3-a74b-4406f67ad298 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 817 time: 0.2229147 Nov 11 14:29:14.022485 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.028592 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-24846439-190f-44aa-bf43-7cca1e0a27b0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 380 time: 0.0971525 Nov 11 14:29:14.041235 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'port': {'device_id': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'admin_state_up': True, 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'security_groups': ['15693065-525e-45e8-892f-4923e0104538']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:14.314078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'name': 'network-vif-deleted', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:14.316067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5dbfc306-8f91-44ac-9c5e-acda1c9ec048" -d '{"events": [{"server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "name": "network-vif-deleted", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:14.356037 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4543a58a-ac75-4a2f-b0c4-b4e87089a993 x-openstack-request-id: req-4543a58a-ac75-4a2f-b0c4-b4e87089a993 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:14.356325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a8d59fd-6d5c-4108-b365-2925718505d9", "name": "network-vif-deleted", "tag": "6f453929-a95f-4aeb-83e9-5b8a818d9859", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:14.356572 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4543a58a-ac75-4a2f-b0c4-b4e87089a993 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:14.357121 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a8d59fd-6d5c-4108-b365-2925718505d9', 'name': 'network-vif-deleted', 'tag': '6f453929-a95f-4aeb-83e9-5b8a818d9859', 'status': 'completed', 'code': 200} Nov 11 14:29:14.359213 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Router fb1030fc-a673-40f8-8acc-5812ce724bec has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:14.361652 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Made reservation on behalf of b69e80bc4d824db9a0104c514f7dc8fa for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:29:14.365258 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.404811 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4822ca19-104e-4361-9aaa-8d6ef2429260 req-a6fbd79f-5f47-4dc9-afa2-19bacabda803 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 210 time: 0.0440965 Nov 11 14:29:14.447415 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3bb86548-dbad-4044-a38e-0210fc7ffe55 req-e965dcb5-74d2-41e6-bb73-c655e3a7fc30 tempest-AttachVolumeNegativeTest-949846701 tempest-AttachVolumeNegativeTest-949846701-project] 10.222.0.10 "GET /v2.0/ports?device_id=6a8d59fd-6d5c-4108-b365-2925718505d9 HTTP/1.1" status: 200 len: 210 time: 0.0270560 Nov 11 14:29:14.594584 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:14.602105 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-c5b334d9-df76-4dbb-abf4-6143c3105edc admin admin] 10.222.0.10 "PUT /v2.0/routers/fb1030fc-a673-40f8-8acc-5812ce724bec/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6428082 Nov 11 14:29:14.604029 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36894) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:14.604164 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Sync routers for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:14.612482 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:14.613083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:14.616453 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Allocated IP 172.20.0.7 (c68a47ca-25f9-4130-912b-bec65a17b2f1/a758aa63-a5a7-49f1-8370-ad64ffdcb95b/4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:29:14.718700 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks [] for router, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.733185 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:14.779727 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.824823 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.861334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.910941 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:29:14.915278 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:29:14.917090 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:14.917748 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54'}], 'enable_snat': True}, 'gw_port_id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 5, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port': {'id': 'fd57231c-3882-4ca8-9947-76ba90b2197b', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:09:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:58Z', 'updated_at': '2021-11-11T14:26:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:14.919255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:29:14.947180 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Deleting port fd57231c-3882-4ca8-9947-76ba90b2197b {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:14.950359 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:14.952242 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Checking router: fb1030fc-a673-40f8-8acc-5812ce724bec for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:14.960962 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Routers {'fb1030fc-a673-40f8-8acc-5812ce724bec'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:14.961694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['fb1030fc-a673-40f8-8acc-5812ce724bec'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:14.975139 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:14.975893 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.046774 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8b7cfac4-13ea-4ab2-ac68-6c98995d6231 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0092130 Nov 11 14:29:15.047310 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] For port fd57231c-3882-4ca8-9947-76ba90b2197b, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=fd57231c-3882-4ca8-9947-76ba90b2197b,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:15.047719 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.054779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] Set router fb1030fc-a673-40f8-8acc-5812ce724bec gateway port host: None {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:15.059468 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Request body: {'port': {'device_id': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:15.067967 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Calling delete_port for fd57231c-3882-4ca8-9947-76ba90b2197b owned by network:router_gateway {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:15.114639 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:29:14Z', 'revision_number': 6, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:15.123467 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.153577 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89df329f-9892-4b87-a3ae-3b852434434f None None] The sync data for ids ['fb1030fc-a673-40f8-8acc-5812ce724bec'] in dv-cinder-777031-9-iscsi is: [{'id': 'fb1030fc-a673-40f8-8acc-5812ce724bec', 'name': 'tempest-TestMinimumBasicScenario-805180888-router', 'tenant_id': '43dc465eb95943ee921d1e983a7e0320', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:57Z', 'updated_at': '2021-11-11T14:29:14Z', 'revision_number': 6, 'project_id': '43dc465eb95943ee921d1e983a7e0320', 'gw_port_host': None}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:15.219089 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-3b6af1f5-a6d2-4861-9a01-576b5ae197a8 None None] Provisioning complete for port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:29:15.219576 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3b6af1f5-a6d2-4861-9a01-576b5ae197a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.260813 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-3b6af1f5-a6d2-4861-9a01-576b5ae197a8 None None] Port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:29:15.404386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:29:15.412777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.517158 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36900) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:15.541289 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-289b4bb1-2101-46a8-bd08-8644b14c42e2 req-01f4bd92-20bb-4e5e-91c3-70da2326aab0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:15.543023 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-289b4bb1-2101-46a8-bd08-8644b14c42e2 req-01f4bd92-20bb-4e5e-91c3-70da2326aab0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 931 time: 0.0618460 Nov 11 14:29:15.565777 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Deleting subnet 8112b7d5-8b09-4390-bcfa-982686a4a63b {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:29:15.570119 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.581207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Transition to ACTIVE for port object 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:29:15.596153 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.610932 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-289b4bb1-2101-46a8-bd08-8644b14c42e2 req-3b356857-f371-4fca-8c35-97d90f694094 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592144 Nov 11 14:29:15.630674 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Pushing event deleted for resources: {'Port': ['ID=fd57231c-3882-4ca8-9947-76ba90b2197b,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:15.635661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129741504'] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.649509 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.699342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:15.720073 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.743836 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.781364 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Attempting to bind port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:29:15.781701 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Attempting to bind port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:29:15.782021 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Attempting to bind port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:29:15.786699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b on network c68a47ca-25f9-4130-912b-bec65a17b2f1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:29:15.787888 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Attempting to bind port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b on network c68a47ca-25f9-4130-912b-bec65a17b2f1 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:29:15.793005 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 29, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:29:15.793341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Checking segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:29:15.793726 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Bound using segment: {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:29:15.794152 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Bound port: 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '71ca5e77-82e8-4016-9192-b9657483c90f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 301, 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:29:15.794508 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.860742 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.861944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.865555 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:29:15.868867 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:29:15.924400 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.961090 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:15.961708 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.963097 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] 10.222.0.11 "PUT /v2.0/ports/4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 1093 time: 0.9082005 Nov 11 14:29:15.970705 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-125906296', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-129288619'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.982079 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217f618b-94b8-4271-a8ed-b59722481a80 service neutron] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:15.989021 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:15.992459 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] 10.222.0.10 "DELETE /v2.0/subnets/8112b7d5-8b09-4390-bcfa-982686a4a63b HTTP/1.1" status: 204 len: 168 time: 0.4740233 Nov 11 14:29:15.994945 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36902) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:16.011199 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e7fdf4-817b-4662-a39a-424f0953990a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8112b7d5-8b09-4390-bcfa-982686a4a63b,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:16.013434 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.013982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Fanout notify agent at l3_agent the message router_deleted on router fb1030fc-a673-40f8-8acc-5812ce724bec {{(pid=102268) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:29:16.033675 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.033675 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-0df219c8-9201-4bbd-a5cb-17580a0f3a2e admin admin] 10.222.0.10 "DELETE /v2.0/routers/fb1030fc-a673-40f8-8acc-5812ce724bec HTTP/1.1" status: 204 len: 168 time: 1.4166262 Nov 11 14:29:16.034854 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36904) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:16.076641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.091762 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Deleting subnet 7c279c15-72b2-4ea5-aa18-273542134660 {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:29:16.095206 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.152179 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129741504'] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.212456 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device fd57231c-3882-4ca8-9947-76ba90b2197b no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:16.226066 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-e002727d-9bbd-4925-bac1-a6735e523701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:16.227627 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-e002727d-9bbd-4925-bac1-a6735e523701 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1096 time: 0.1440794 Nov 11 14:29:16.229137 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.241947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: fd57231c-3882-4ca8-9947-76ba90b2197b {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:16.242514 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device fd57231c-3882-4ca8-9947-76ba90b2197b not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:16.243090 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b97f6646-ee4c-4dac-9a61-7b951a205fbf no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:16.263772 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: b97f6646-ee4c-4dac-9a61-7b951a205fbf {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:16.264105 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b97f6646-ee4c-4dac-9a61-7b951a205fbf not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:16.281007 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-796db3db-82c0-41cd-baa8-9f32658afd91 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 217 time: 0.0436909 Nov 11 14:29:16.290182 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.290507 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['46c60fd1-4f35-496c-adf1-1f850a03f8d7']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:16.327158 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 6f453929-a95f-4aeb-83e9-5b8a818d9859 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:16.328193 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a261d729-bba1-440e-ba21-5fcca20345f3') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:16.328590 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a261d729-bba1-440e-ba21-5fcca20345f3') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:16.343884 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.351312 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 6f453929-a95f-4aeb-83e9-5b8a818d9859 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:16.353336 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 6f453929-a95f-4aeb-83e9-5b8a818d9859 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:16.358800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:16.361064 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67d17829-5eb7-41cc-bc85-a17f6d0b574a" -d '{"events": [{"name": "network-changed", "server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:16.367023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.369922 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-e0981f23-9f8a-40a2-9958-ed5d7b5447f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:16.371386 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-e0981f23-9f8a-40a2-9958-ed5d7b5447f0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0828419 Nov 11 14:29:16.376106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Releasing vlan 342 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:29:16.376746 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:29:16.380016 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:29:16.407696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28da8349-b442-44d5-94f9-7e4b5365ea22 x-openstack-request-id: req-28da8349-b442-44d5-94f9-7e4b5365ea22 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:16.407982 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:16.408234 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-28da8349-b442-44d5-94f9-7e4b5365ea22 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:16.408624 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'status': 'completed', 'code': 200} Nov 11 14:29:16.432929 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-125906296', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-129288619'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.461952 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7c279c15-72b2-4ea5-aa18-273542134660,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:16.463866 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.467151 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-7ab3d31d-ec36-475e-a1e7-9811c41de67b admin admin] 10.222.0.10 "DELETE /v2.0/subnets/7c279c15-72b2-4ea5-aa18-273542134660 HTTP/1.1" status: 204 len: 168 time: 0.4312046 Nov 11 14:29:16.469815 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36908) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:16.470706 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-746b2055-7957-41cd-b5c0-6de983b236e3 None None] Network 974515c5-e282-45f9-84fa-971ce619e2ed requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:16.542594 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.599558 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Deleting port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:16.599899 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.659512 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] DHCP port deletion for 974515c5-e282-45f9-84fa-971ce619e2ed request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:29:16.672832 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] For port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:16.673210 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.692344 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Calling delete_port for 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:16.730841 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Deleting port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:16.731325 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.759408 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8169d479-b49b-4a15-ac56-60efd286a433 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:16.760889 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-8169d479-b49b-4a15-ac56-60efd286a433 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3700192 Nov 11 14:29:16.784187 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc18971-7a62-496e-b2b0-e60fbed3e6b0 req-ea1344c4-ab70-4930-847e-62ac707998cd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:16.785675 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0dc18971-7a62-496e-b2b0-e60fbed3e6b0 req-ea1344c4-ab70-4930-847e-62ac707998cd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0770204 Nov 11 14:29:16.800244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] For port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,segment=NetworkSegment(e4a3441b-73d8-49a9-8956-724958d2a291),segment_id=e4a3441b-73d8-49a9-8956-724958d2a291)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:16.801191 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.803029 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.814582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Calling delete_port for 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:16.820233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.823359 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] 10.222.0.10 "DELETE /v2.0/networks/46c60fd1-4f35-496c-adf1-1f850a03f8d7 HTTP/1.1" status: 204 len: 168 time: 0.8269141 Nov 11 14:29:16.864121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c78fbe-7e52-422c-a0ea-8065954d4bda admin admin] Pushing event deleted for resources: {'Network': ['ID=46c60fd1-4f35-496c-adf1-1f850a03f8d7,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:16.872503 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.908437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] No DVR routers for this DVR port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:16.908647 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0dc18971-7a62-496e-b2b0-e60fbed3e6b0 req-982f6c3b-7c7b-4e28-9e93-91e1c917fdad tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1100650 Nov 11 14:29:16.927158 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-0eb6af25-7e9b-4c65-836f-72c51c5a7cb2 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1584237 Nov 11 14:29:16.939863 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Pushing event deleted for resources: {'Port': ['ID=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:16.947675 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:16.973529 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] Pushing event deleted for resources: {'Port': ['ID=7bf74962-e971-4f49-bb81-dbf9b7f1ff23,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:16.977775 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d42b3473-e4b4-4738-a681-8bb2e22a2aef None None] No DVR routers for this DVR port 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:17.014712 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.031923 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b0b4b6f0-8199-486d-96aa-4b321a425a3b req-89046ecf-036c-4f78-b7b5-ab4b4577f7c9 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0965352 Nov 11 14:29:17.035352 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['974515c5-e282-45f9-84fa-971ce619e2ed']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:17.044994 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e4a3441b-73d8-49a9-8956-724958d2a291') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:17.045288 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e4a3441b-73d8-49a9-8956-724958d2a291') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:17.059280 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.072639 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.078455 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Releasing vlan 332 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:29:17.078828 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:29:17.080493 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:29:17.180198 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-a1de28a1-26ba-4c6e-afc5-b3785a32e962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:17.181771 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-a1de28a1-26ba-4c6e-afc5-b3785a32e962 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1096 time: 0.0467651 Nov 11 14:29:17.192403 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.197810 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.204157 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] 10.222.0.10 "DELETE /v2.0/networks/974515c5-e282-45f9-84fa-971ce619e2ed HTTP/1.1" status: 204 len: 168 time: 0.7307148 Nov 11 14:29:17.209426 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36914) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:17.212936 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1153a1b4-f51a-4b59-b7b1-2ece0a88580c admin admin] Pushing event deleted for resources: {'Network': ['ID=974515c5-e282-45f9-84fa-971ce619e2ed,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:17.272241 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36916) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:17.311937 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-41e512c9-acee-4114-a7a2-bde9e9599c67 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=58e5f180c3b54f9882a3b22f6f437768&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0385466 Nov 11 14:29:17.314331 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36918) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:17.357488 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-3a471c1a-a34e-45f3-87b8-c28f00b329a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:17.358942 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-3a471c1a-a34e-45f3-87b8-c28f00b329a8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.1687922 Nov 11 14:29:17.360254 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.386871 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.436707 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-eebf35e9-f2f5-4ef4-ad35-2639f5d5e970 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 217 time: 0.0679796 Nov 11 14:29:17.533102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-95e14169-8574-4c10-8164-1d2c3df2d4de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:17.534621 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-95e14169-8574-4c10-8164-1d2c3df2d4de service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0903337 Nov 11 14:29:17.546445 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.549118 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.550265 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/87303888-f648-400d-a8a2-f70720c6963f HTTP/1.1" status: 204 len: 168 time: 0.2350399 Nov 11 14:29:17.559499 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862cfa70-adbe-4ced-ac73-235a9655c347 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87303888-f648-400d-a8a2-f70720c6963f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:17.614472 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-5740ff6e-3252-416d-a40e-34e6916a0726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:17.615984 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-5740ff6e-3252-416d-a40e-34e6916a0726 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0738113 Nov 11 14:29:17.745972 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-e82062e1-c6e1-41c6-902b-de39966273fe service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1122661 Nov 11 14:29:17.860172 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:17.895437 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67d17829-5eb7-41cc-bc85-a17f6d0b574a req-4d8b0c5f-43ca-420a-97d8-1672e556337a service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1307876 Nov 11 14:29:18.043389 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63123699-790f-4c6e-ac25-e7865d7773cc req-faf08276-5cbc-48d3-8536-a703939ca7ff tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:18.044998 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63123699-790f-4c6e-ac25-e7865d7773cc req-faf08276-5cbc-48d3-8536-a703939ca7ff tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0537395 Nov 11 14:29:18.091540 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-63123699-790f-4c6e-ac25-e7865d7773cc req-8b36b72c-87cc-4e96-b47a-5269788aaed8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405650 Nov 11 14:29:18.116995 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Deleting port 27637972-914c-4969-bca4-2afdaec3b261 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:18.117502 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.178703 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:18.200023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] For port 27637972-914c-4969-bca4-2afdaec3b261, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=27637972-914c-4969-bca4-2afdaec3b261,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:18.200414 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.201491 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:18.201837 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 7bf74962-e971-4f49-bb81-dbf9b7f1ff23 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:18.215142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Calling delete_port for 27637972-914c-4969-bca4-2afdaec3b261 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:18.438013 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.471974 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Pushing event deleted for resources: {'Port': ['ID=27637972-914c-4969-bca4-2afdaec3b261,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:18.564508 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36942) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:18.638342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.671735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1516327432-network', 'tenant_id': '5e4b049d17ef4a17b4ae7613a4b7b7fb'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:18.862102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Router e9d00586-f5bc-4db8-82aa-86105e8cab80 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:18.917843 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Made reservation on behalf of 5e4b049d17ef4a17b4ae7613a4b7b7fb for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:29:18.920095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.929387 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:18.966870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:18.972062 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a554fde0-f710-4e73-9a6a-4eef0e5f5d18 admin admin] 10.222.0.10 "PUT /v2.0/routers/e9d00586-f5bc-4db8-82aa-86105e8cab80/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7615883 Nov 11 14:29:18.974549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36948) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:18.976799 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Sync routers for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:18.987260 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:18.991781 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:19.084688 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.091880 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:19.100911 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks [] for router, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.183177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.214350 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe6eb99-89dd-495d-9e22-ea25c747bce2 req-b27be025-a2a9-43ac-aa11-905d091e024c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:19.215901 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2fe6eb99-89dd-495d-9e22-ea25c747bce2 req-b27be025-a2a9-43ac-aa11-905d091e024c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0512543 Nov 11 14:29:19.222400 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 306} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:29:19.238980 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e5c265d-03c9-4eb1-9131-6bc01d38835b,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:19.245514 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.253134 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.253554 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Added segment 068e6de9-de02-49da-9c08-a968e424d55d of type vlan for network e8afa491-56ef-4ae9-94fa-22773ddc795c Nov 11 14:29:19.270508 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2fe6eb99-89dd-495d-9e22-ea25c747bce2 req-58f1e93c-01d5-4704-ba61-8c0c1cfec557 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473928 Nov 11 14:29:19.283467 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': '324d2670-88f2-47c2-ae08-2130306612f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:29:18Z', 'revision_number': 5, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port': {'id': '324d2670-88f2-47c2-ae08-2130306612f3', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:8c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:26:05Z', 'updated_at': '2021-11-11T14:26:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:19.301531 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.313980 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Checking router: e9d00586-f5bc-4db8-82aa-86105e8cab80 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:19.322726 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Routers {'e9d00586-f5bc-4db8-82aa-86105e8cab80'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:19.323323 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e9d00586-f5bc-4db8-82aa-86105e8cab80'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:19.364735 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Deleting port 324d2670-88f2-47c2-ae08-2130306612f3 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:19.365061 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.383714 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.384653 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:19.385220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.407767 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] Set router e9d00586-f5bc-4db8-82aa-86105e8cab80 gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:19.460042 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:29:19Z', 'revision_number': 6, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:19.483796 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] Pushing event updated for resources: {'Network': ['ID=e8afa491-56ef-4ae9-94fa-22773ddc795c,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:19.493358 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ef2963d-bce6-4866-a46a-c5221875173e None None] The sync data for ids ['e9d00586-f5bc-4db8-82aa-86105e8cab80'] in dv-cinder-777031-9-iscsi is: [{'id': 'e9d00586-f5bc-4db8-82aa-86105e8cab80', 'name': 'tempest-TestMinimumBasicScenario-221554170-router', 'tenant_id': '52b6cc5d3c34431399cfdc162f14356f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:26:04Z', 'updated_at': '2021-11-11T14:29:19Z', 'revision_number': 6, 'project_id': '52b6cc5d3c34431399cfdc162f14356f', 'gw_port_host': None}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:19.495878 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network e8afa491-56ef-4ae9-94fa-22773ddc795c details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:29:19.508867 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] For port 324d2670-88f2-47c2-ae08-2130306612f3, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=324d2670-88f2-47c2-ae08-2130306612f3,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:19.509116 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.524968 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Calling delete_port for 324d2670-88f2-47c2-ae08-2130306612f3 owned by network:router_gateway {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:19.590745 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-469d397b-f27d-416f-9731-de291232feb3 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.0251720 Nov 11 14:29:19.593640 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36952) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:19.599062 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Request body: {'subnet': {'network_id': 'e8afa491-56ef-4ae9-94fa-22773ddc795c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1516327432-subnet', 'tenant_id': '5e4b049d17ef4a17b4ae7613a4b7b7fb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:19.735218 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Made reservation on behalf of 5e4b049d17ef4a17b4ae7613a4b7b7fb for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:29:19.737478 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.758034 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.782626 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Pushing event deleted for resources: {'Port': ['ID=324d2670-88f2-47c2-ae08-2130306612f3,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:19.853087 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.950097 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.952196 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:19.980875 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.036632 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe1ea84a-3819-4013-8da2-85596875905e,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:20.045939 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Checking segment: {'id': '068e6de9-de02-49da-9c08-a968e424d55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 306, 'network_id': 'e8afa491-56ef-4ae9-94fa-22773ddc795c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:29:20.046293 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Network hostable DHCP agents. Network: e8afa491-56ef-4ae9-94fa-22773ddc795c, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:29:20.088619 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.089142 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Fanout notify agent at l3_agent the message router_deleted on router e9d00586-f5bc-4db8-82aa-86105e8cab80 {{(pid=102268) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:29:20.098222 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.098222 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ea5ab8d4-565d-4e64-909b-286f62967c9e admin admin] 10.222.0.10 "DELETE /v2.0/routers/e9d00586-f5bc-4db8-82aa-86105e8cab80 HTTP/1.1" status: 204 len: 168 time: 1.1189573 Nov 11 14:29:20.098437 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36954) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:20.145263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Deleting subnet 107ceeab-6d4d-485b-9235-1cf7f0b88b8e {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:29:20.148293 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.168155 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Network e8afa491-56ef-4ae9-94fa-22773ddc795c is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:29:20.185935 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.247760 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, e8afa491-56ef-4ae9-94fa-22773ddc795c) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:29:20.262300 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc357cee-18f7-4491-a8a5-383ec6eb4caa None None] Network e8afa491-56ef-4ae9-94fa-22773ddc795c requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:20.283704 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:20.284309 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.328235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 27637972-914c-4969-bca4-2afdaec3b261 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:20.330416 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:29:20.335022 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.362701 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 27637972-914c-4969-bca4-2afdaec3b261 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:20.363344 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 27637972-914c-4969-bca4-2afdaec3b261 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:20.363981 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 324d2670-88f2-47c2-ae08-2130306612f3 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:20.396482 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 324d2670-88f2-47c2-ae08-2130306612f3 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:20.397185 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 324d2670-88f2-47c2-ae08-2130306612f3 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:20.424628 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75adabe7-efb3-4bc6-ad92-9f2d1ecd2071 req-8b2c386d-3c47-42fe-b120-c700f44f3ce8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:20.426880 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-75adabe7-efb3-4bc6-ad92-9f2d1ecd2071 req-8b2c386d-3c47-42fe-b120-c700f44f3ce8 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0762281 Nov 11 14:29:20.485407 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-75adabe7-efb3-4bc6-ad92-9f2d1ecd2071 req-dd5cf2be-563a-4e69-a878-c5902e22ddf5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517588 Nov 11 14:29:20.522706 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a22e2b6e-5aec-49b6-b6f6-c123706a62b6 None None] Network e8afa491-56ef-4ae9-94fa-22773ddc795c requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:20.596765 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:20.616592 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:29:20.623235 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7879018b-a19c-4b78-87a3-32ee09bef504 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0260856 Nov 11 14:29:20.694788 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.726547 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:29:20.735849 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.767578 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=107ceeab-6d4d-485b-9235-1cf7f0b88b8e,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:20.779744 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.787242 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1e462e2d-5c01-40be-afff-ed1cf919b5f8 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/107ceeab-6d4d-485b-9235-1cf7f0b88b8e HTTP/1.1" status: 204 len: 168 time: 0.6882873 Nov 11 14:29:20.787567 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36962) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:20.864530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.875222 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:20.878592 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f375bb8-2860-4bee-a679-10014530cf7b None None] Network e8ede3e1-9308-43ec-aeec-7d48572a8d4b requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:20.918419 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Deleting port 290f782f-aa7a-4e53-95a5-a592520e2d45 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:20.918662 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.927831 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:20.987523 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] For port 290f782f-aa7a-4e53-95a5-a592520e2d45, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=290f782f-aa7a-4e53-95a5-a592520e2d45,segment=NetworkSegment(7e1e5771-5b6e-4c8d-9cb9-078030d0f59a),segment_id=7e1e5771-5b6e-4c8d-9cb9-078030d0f59a)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:20.987945 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.001429 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Calling delete_port for 290f782f-aa7a-4e53-95a5-a592520e2d45 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:21.021326 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.122800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] DHCP port deletion for e8ede3e1-9308-43ec-aeec-7d48572a8d4b request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:29:21.146060 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.161988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:29:21.173099 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Pushing event deleted for resources: {'Port': ['ID=290f782f-aa7a-4e53-95a5-a592520e2d45,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.175488 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] No DVR routers for this DVR port 290f782f-aa7a-4e53-95a5-a592520e2d45 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:21.206615 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Deleting port 290f782f-aa7a-4e53-95a5-a592520e2d45 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:29:21.207006 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.253761 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.276908 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e8ede3e1-9308-43ec-aeec-7d48572a8d4b']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:21.287327 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] For port 290f782f-aa7a-4e53-95a5-a592520e2d45, host dv-cinder-777031-9-iscsi, got binding levels [] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:21.287968 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.294778 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:21.295171 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e1e5771-5b6e-4c8d-9cb9-078030d0f59a') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:21.305621 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.306976 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Calling delete_port for 290f782f-aa7a-4e53-95a5-a592520e2d45 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:29:21.310761 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.ipam_backend_mixin [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Port 290f782f-aa7a-4e53-95a5-a592520e2d45 was not found and therefore no delete operation was performed {{(pid=102269) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 11 14:29:21.317080 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.320569 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.327154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Releasing vlan 316 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:29:21.327637 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:29:21.329417 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:29:21.340287 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36974) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:21.345018 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-687927427-network', 'tenant_id': 'd9ac7b06afda46839caaca8dab78bebf'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:21.361617 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] Pushing event deleted for resources: {'Port': ['ID=290f782f-aa7a-4e53-95a5-a592520e2d45,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.361617 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6afa2df3-d65f-4e75-b754-c582c578f51a None None] No DVR routers for this DVR port 290f782f-aa7a-4e53-95a5-a592520e2d45 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:29:21.512302 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Made reservation on behalf of d9ac7b06afda46839caaca8dab78bebf for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:29:21.514633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.516825 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.528530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.531828 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] 10.222.0.10 "DELETE /v2.0/networks/e8ede3e1-9308-43ec-aeec-7d48572a8d4b HTTP/1.1" status: 204 len: 168 time: 0.7431285 Nov 11 14:29:21.533940 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.544914 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c430da11-77a2-4148-9cb2-2ae02d5edc26 admin admin] Pushing event deleted for resources: {'Network': ['ID=e8ede3e1-9308-43ec-aeec-7d48572a8d4b,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.623475 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e704dc-35e0-4cf3-acec-de9ba1643fe8 req-28173063-bf94-429a-bdbc-5cf1002fd221 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:21.624926 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-44e704dc-35e0-4cf3-acec-de9ba1643fe8 req-28173063-bf94-429a-bdbc-5cf1002fd221 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 944 time: 0.0599325 Nov 11 14:29:21.634232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.675251 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-44e704dc-35e0-4cf3-acec-de9ba1643fe8 req-bd10d252-4bd1-4d09-b910-1d93df0b041d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429323 Nov 11 14:29:21.717444 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.742678 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 325} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:29:21.752229 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79753e88-5778-4643-8558-d541951c6967,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.756829 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.757171 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Added segment ad74b01b-fde9-4e6a-854c-3ac477f69259 of type vlan for network 30351eba-4e8a-40aa-9b62-413036e267c2 Nov 11 14:29:21.796119 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.877572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.878475 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:21.879109 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:21.942552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] Pushing event updated for resources: {'Network': ['ID=30351eba-4e8a-40aa-9b62-413036e267c2,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:21.945815 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 36980) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:21.953624 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 30351eba-4e8a-40aa-9b62-413036e267c2 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:29:21.962512 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8d74d614-6134-4a55-a3e9-b8bda10ac74d admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6211553 Nov 11 14:29:21.965968 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36982) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:21.973296 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Request body: {'subnet': {'network_id': '30351eba-4e8a-40aa-9b62-413036e267c2', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-687927427-subnet', 'tenant_id': 'd9ac7b06afda46839caaca8dab78bebf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:21.990607 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e56bc9eb-81ce-4efb-8c97-4498edf0b605 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=43dc465eb95943ee921d1e983a7e0320&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0437081 Nov 11 14:29:21.993142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36984) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:22.044112 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.063021 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Made reservation on behalf of d9ac7b06afda46839caaca8dab78bebf for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:29:22.065383 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.068813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.165328 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 290f782f-aa7a-4e53-95a5-a592520e2d45 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:29:22.188181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 290f782f-aa7a-4e53-95a5-a592520e2d45 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:29:22.188631 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 290f782f-aa7a-4e53-95a5-a592520e2d45 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:29:22.261395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.263971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.266062 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/ca12ff19-a5ee-463e-88da-8321437b44a1 HTTP/1.1" status: 204 len: 168 time: 0.2709825 Nov 11 14:29:22.274386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bae942c-46b1-43c4-9cc2-8e6ae6b8d655 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca12ff19-a5ee-463e-88da-8321437b44a1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:22.352810 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.357063 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:29:22.419585 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3b91ae85-eb98-44b5-9990-73af1447bee3,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:22.424714 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Checking segment: {'id': 'ad74b01b-fde9-4e6a-854c-3ac477f69259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 325, 'network_id': '30351eba-4e8a-40aa-9b62-413036e267c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:29:22.425067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Network hostable DHCP agents. Network: 30351eba-4e8a-40aa-9b62-413036e267c2, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:29:22.460620 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:29:22.464497 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:29:22.466874 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.506491 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Network 30351eba-4e8a-40aa-9b62-413036e267c2 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:29:22.540576 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.562547 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:22.564787 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6512860-a834-43cd-883d-9c2fc0645792" -d '{"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:22.578943 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:29:22.620486 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 30351eba-4e8a-40aa-9b62-413036e267c2) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:29:22.625592 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:22.626922 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.632597 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ff614dc-d6e8-4bde-a109-f56b26b6d80c None None] Network 30351eba-4e8a-40aa-9b62-413036e267c2 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:22.686255 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.724926 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-18b6bca0-3852-47a6-8319-fad44d744c77 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.7574353 Nov 11 14:29:22.740592 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a7726a1-303e-4dc8-9846-1f3b2aa68b01 x-openstack-request-id: req-6a7726a1-303e-4dc8-9846-1f3b2aa68b01 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:22.740878 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:22.741323 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-6a7726a1-303e-4dc8-9846-1f3b2aa68b01 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:22.741716 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'code': 200} Nov 11 14:29:22.780422 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:22.818011 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e113af-148b-4422-9b20-30443d987faf req-93e7d6da-8c5e-4f95-a434-6c7c8ea79656 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:22.819831 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-38e113af-148b-4422-9b20-30443d987faf req-93e7d6da-8c5e-4f95-a434-6c7c8ea79656 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0620029 Nov 11 14:29:22.844382 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f99e3a3-d1b4-4e38-962e-edf44682cd9b None None] Network 30351eba-4e8a-40aa-9b62-413036e267c2 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:29:22.867870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 36998) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:22.912961 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-38e113af-148b-4422-9b20-30443d987faf req-9b58d6e2-c15a-48cf-8d54-06818e9d64e9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0865691 Nov 11 14:29:22.930037 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Deleting subnet fe1ea84a-3819-4013-8da2-85596875905e {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:29:22.942798 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:22.965530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37000) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:22.985383 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.009383 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1f746055-72d3-4391-9fc3-1b4bc06ab851 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=52b6cc5d3c34431399cfdc162f14356f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0421250 Nov 11 14:29:23.011861 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37002) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:23.052233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.058646 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.080152 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.082447 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267e6eb1-e8c5-4c61-8b91-33ebc9a5590c req-bd8f3e64-4550-412d-b419-1abbb2cc2bcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:23.083977 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-267e6eb1-e8c5-4c61-8b91-33ebc9a5590c req-bd8f3e64-4550-412d-b419-1abbb2cc2bcf service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1098 time: 0.0786626 Nov 11 14:29:23.141588 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-267e6eb1-e8c5-4c61-8b91-33ebc9a5590c req-89b924b0-ea69-45de-8fe2-56089e6b0c9f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499122 Nov 11 14:29:23.174787 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.178080 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.184375 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/0f2663ce-b6cd-4aa1-bb6a-ab0b84478f84 HTTP/1.1" status: 204 len: 168 time: 0.1663940 Nov 11 14:29:23.187209 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30b9da1-1fce-464a-9e8a-579a81637968 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f2663ce-b6cd-4aa1-bb6a-ab0b84478f84,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:23.205065 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.231591 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe1ea84a-3819-4013-8da2-85596875905e,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:23.237183 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.243830 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37006) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:23.243988 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-afdc3f59-a34a-4dd3-b25b-f61abf84b125 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/fe1ea84a-3819-4013-8da2-85596875905e HTTP/1.1" status: 204 len: 168 time: 0.3726156 Nov 11 14:29:23.313313 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.393239 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.412793 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e8afa491-56ef-4ae9-94fa-22773ddc795c']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:23.421540 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '068e6de9-de02-49da-9c08-a968e424d55d') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:23.421827 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '068e6de9-de02-49da-9c08-a968e424d55d') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:23.430718 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.443741 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.449405 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Releasing vlan 306 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:29:23.449779 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:29:23.451699 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:29:23.586751 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.592478 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.595790 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] 10.222.0.10 "DELETE /v2.0/networks/e8afa491-56ef-4ae9-94fa-22773ddc795c HTTP/1.1" status: 204 len: 168 time: 0.3509560 Nov 11 14:29:23.598854 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37008) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:23.606995 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc783ad9-e7f9-4b06-9a03-155325692dbd admin admin] Pushing event deleted for resources: {'Network': ['ID=e8afa491-56ef-4ae9-94fa-22773ddc795c,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:23.648972 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Deleting subnet 3b91ae85-eb98-44b5-9990-73af1447bee3 {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:29:23.652241 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.687087 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.729426 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.838070 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.862978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3b91ae85-eb98-44b5-9990-73af1447bee3,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:23.866616 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:23.869825 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-74122915-b3f7-4862-bdda-10ce337e052f admin admin] 10.222.0.10 "DELETE /v2.0/subnets/3b91ae85-eb98-44b5-9990-73af1447bee3 HTTP/1.1" status: 204 len: 168 time: 0.2696612 Nov 11 14:29:23.872537 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37010) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:23.937496 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.019883 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.039447 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b21e783-151b-45cf-ade5-e1a4e955d7c2 req-dad0623e-84e2-4bf3-a6e3-e2f030fd1f26 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:24.040004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['30351eba-4e8a-40aa-9b62-413036e267c2']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:24.040938 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6b21e783-151b-45cf-ade5-e1a4e955d7c2 req-dad0623e-84e2-4bf3-a6e3-e2f030fd1f26 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0529726 Nov 11 14:29:24.048648 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ad74b01b-fde9-4e6a-854c-3ac477f69259') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:24.048944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ad74b01b-fde9-4e6a-854c-3ac477f69259') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:24.059169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.072668 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.078627 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Releasing vlan 325 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:29:24.079003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:29:24.080663 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:29:24.089883 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6b21e783-151b-45cf-ade5-e1a4e955d7c2 req-dda1a4bd-1531-4018-b100-393206acdb3d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405562 Nov 11 14:29:24.192252 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.198241 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.201526 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] 10.222.0.10 "DELETE /v2.0/networks/30351eba-4e8a-40aa-9b62-413036e267c2 HTTP/1.1" status: 204 len: 168 time: 0.3280842 Nov 11 14:29:24.214802 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f767da5-5012-4ab8-b7eb-6c27a42d6110 admin admin] Pushing event deleted for resources: {'Network': ['ID=30351eba-4e8a-40aa-9b62-413036e267c2,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:24.581065 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37016) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:24.625257 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-bde9a9ee-fff7-4dbe-b102-689e942923df admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5e4b049d17ef4a17b4ae7613a4b7b7fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0426993 Nov 11 14:29:24.627676 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37018) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:24.673425 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.694228 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.837514 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.840091 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:24.841269 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/8e5c265d-03c9-4eb1-9131-6bc01d38835b HTTP/1.1" status: 204 len: 168 time: 0.2126846 Nov 11 14:29:24.849793 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e817e44-d2c2-46ca-82d7-1e8db45b07cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e5c265d-03c9-4eb1-9131-6bc01d38835b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:25.211612 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2457c8f7-0c9d-4bd4-8bb6-39c93e359e65 req-2ad926c7-ed86-45a8-a943-7fb88539b780 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:25.213085 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2457c8f7-0c9d-4bd4-8bb6-39c93e359e65 req-2ad926c7-ed86-45a8-a943-7fb88539b780 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0507722 Nov 11 14:29:25.259956 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2457c8f7-0c9d-4bd4-8bb6-39c93e359e65 req-563ff91d-df51-4f99-aa69-6920f2fd9126 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408769 Nov 11 14:29:25.373155 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b864afd0-82d1-497c-b7ce-d37b343400a5 req-17bdd34e-adfe-424a-9446-bb6803349785 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:25.374640 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b864afd0-82d1-497c-b7ce-d37b343400a5 req-17bdd34e-adfe-424a-9446-bb6803349785 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0486124 Nov 11 14:29:25.383641 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37030) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:25.388041 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Request body: {'floatingip': {'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:29:25.426795 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:25.478427 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37032) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:25.516996 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-64849e96-da55-4024-a531-d6382961c752 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d9ac7b06afda46839caaca8dab78bebf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0374134 Nov 11 14:29:25.520152 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37034) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:25.565688 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:25.587317 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:25.735135 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:25.738009 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:25.739198 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/79753e88-5778-4643-8558-d541951c6967 HTTP/1.1" status: 204 len: 168 time: 0.2181454 Nov 11 14:29:25.747534 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18df94e1-d855-4ebc-a1e0-2c6fe5cd3ed2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79753e88-5778-4643-8558-d541951c6967,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:26.161406 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:26.214938 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:26.315950 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Floating IP 97daf15f-148a-4c31-828b-edd84a0fc1c8 associated. External IP: 172.27.1.86, port: 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b. Nov 11 14:29:26.525637 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:29:26.635426 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:29:26.640450 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:26.645792 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:29:26.655861 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:26.656479 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:26.668199 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-0568fd34-6322-46d6-8110-bc93a57ff267 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "PUT /v2.0/floatingips/97daf15f-148a-4c31-828b-edd84a0fc1c8 HTTP/1.1" status: 200 len: 990 time: 1.2834153 Nov 11 14:29:26.668858 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:29:26.671217 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a53031e6-6679-4c34-ae04-c1cde72341cf" -d '{"events": [{"name": "network-changed", "server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:29:26.713756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:29:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c929ed2c-c8e3-419c-889f-c43f8ed24b82 x-openstack-request-id: req-c929ed2c-c8e3-419c-889f-c43f8ed24b82 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:29:26.714053 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:29:26.714306 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-c929ed2c-c8e3-419c-889f-c43f8ed24b82 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:29:26.714723 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'status': 'completed', 'code': 200} Nov 11 14:29:26.779196 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:26.786395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-db3826d4-c51f-45f7-962d-18c81ad7b701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:26.787901 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-db3826d4-c51f-45f7-962d-18c81ad7b701 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1098 time: 0.0481794 Nov 11 14:29:26.888505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-70a57c4e-a3ec-4c4f-8793-2eaa14951f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:26.889986 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-70a57c4e-a3ec-4c4f-8793-2eaa14951f8e service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0928712 Nov 11 14:29:26.966352 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-d0765a63-95d5-4345-957b-e12721bf74ed service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 998 time: 0.0683095 Nov 11 14:29:27.013139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '97daf15f-148a-4c31-828b-edd84a0fc1c8', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.86', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 511, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:26Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:27.016818 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-f4d8d7d1-4497-40c3-8dc7-22993fcb6b70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:27.018345 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-f4d8d7d1-4497-40c3-8dc7-22993fcb6b70 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0437655 Nov 11 14:29:27.040761 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:29:27.049023 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:29:27.049631 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:29:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:27.066524 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-032ac38d-18e1-472f-bf23-ff7e833fd01d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:29:27.068175 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-032ac38d-18e1-472f-bf23-ff7e833fd01d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418761 Nov 11 14:29:27.157566 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:29:27.167927 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-63b5cd05-8225-45dc-a05d-1e26a0d2755f service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0913124 Nov 11 14:29:27.264606 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a53031e6-6679-4c34-ae04-c1cde72341cf req-6a69dcab-2638-4e23-9e06-b9e2dcab9faf service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0897582 Nov 11 14:29:27.392260 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '97daf15f-148a-4c31-828b-edd84a0fc1c8', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.86', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 511, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:26Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:29:27.422853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bda4c542-e3e5-443c-9601-14b7420c6599 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '97daf15f-148a-4c31-828b-edd84a0fc1c8', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'floating_ip_address': '172.27.1.86', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 511, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:26Z', 'revision_number': 1, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:29:27.607694 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a55564b-b262-4a17-812c-27ccb1c17a16 None None] New status for floating IP 97daf15f-148a-4c31-828b-edd84a0fc1c8: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:29:30.320725 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37176) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:30.421080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95278f4a-0c12-4997-863a-2998d6b10447 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.495908 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95278f4a-0c12-4997-863a-2998d6b10447 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.545828 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-95278f4a-0c12-4997-863a-2998d6b10447 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.583475 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-95278f4a-0c12-4997-863a-2998d6b10447 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=6ce98a8e72dd4c9a92a6b52dc176e489&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2616415 Nov 11 14:29:30.585406 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95278f4a-0c12-4997-863a-2998d6b10447 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a52e7aa-80d0-493c-a09d-93640424651a,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:30.586161 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37180) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:30.635723 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.657208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.768458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.771470 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:30.772621 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/0a52e7aa-80d0-493c-a09d-93640424651a HTTP/1.1" status: 204 len: 168 time: 0.1854813 Nov 11 14:29:30.780367 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6540678-9697-4676-bab0-95245209fef3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a52e7aa-80d0-493c-a09d-93640424651a,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:31.313014 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37188) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:31.325826 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eecd3b6f-82b1-43cc-a317-0c260ff733a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.397093 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eecd3b6f-82b1-43cc-a317-0c260ff733a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.483280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eecd3b6f-82b1-43cc-a317-0c260ff733a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.520760 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-eecd3b6f-82b1-43cc-a317-0c260ff733a6 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=5efdf50069e54c1bb407e68c933dbc35&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2067096 Nov 11 14:29:31.521600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eecd3b6f-82b1-43cc-a317-0c260ff733a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3865b32-2830-4363-8a23-f74cc282ab7f,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:31.523469 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37190) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:29:31.574078 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.594737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.717584 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.720224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:31.721369 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b3865b32-2830-4363-8a23-f74cc282ab7f HTTP/1.1" status: 204 len: 168 time: 0.1969380 Nov 11 14:29:31.729973 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69dc1f01-1011-4217-bc04-7223c53bd4c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3865b32-2830-4363-8a23-f74cc282ab7f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:29:35.352001 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:29:36.020220 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-aa6fc555-5b3f-4ccf-acbe-813553794966 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:38.442942 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0eba82e3-bfac-4edb-8d7d-13a948f2f8ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:39.631579 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:40.740036 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:41.694321 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:29:42.082977 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:06.008258 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fb343453-a049-4b68-8129-ed3e437841d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:06.921474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37448) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:07.029804 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.100060 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.167287 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.208535 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=a12481937143444587b032921380005a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2860100 Nov 11 14:30:07.210267 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92118d7b-41ac-46f8-842c-d6b50d461b5f,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:07.211842 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37452) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:07.217366 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.217705 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.218037 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.218365 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.218685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.219007 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.219329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.219675 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.219995 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.220311 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.220625 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.220943 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ecb8e10-d313-4ae6-8a86-c0a2d3d3002d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.262848 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.280400 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.402366 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.404991 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:07.406208 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/92118d7b-41ac-46f8-842c-d6b50d461b5f HTTP/1.1" status: 204 len: 168 time: 0.1933107 Nov 11 14:30:07.414727 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92118d7b-41ac-46f8-842c-d6b50d461b5f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:07.421779 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.422128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.422463 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.422792 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.423115 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.423468 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.423792 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.424139 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.424477 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.424749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.425062 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:07.425463 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99af6a26-fe54-4b50-a631-1589a3173dbe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:08.026279 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37460) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:08.039138 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-17e39541-c252-48dd-a304-8c35d801e0f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.113865 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-17e39541-c252-48dd-a304-8c35d801e0f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.185474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-17e39541-c252-48dd-a304-8c35d801e0f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.223707 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-17e39541-c252-48dd-a304-8c35d801e0f7 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c982d25c3ad54414bae6aa9edc453af3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1963744 Nov 11 14:30:08.224868 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e39541-c252-48dd-a304-8c35d801e0f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36f57e6a-8760-40ba-bde7-f2efc8835141,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:08.227478 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37462) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:08.275892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.296741 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.437202 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.439907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:08.441063 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/36f57e6a-8760-40ba-bde7-f2efc8835141 HTTP/1.1" status: 204 len: 168 time: 0.2123828 Nov 11 14:30:08.448876 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2554e4e-5d77-48dd-bec5-a96158821666 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36f57e6a-8760-40ba-bde7-f2efc8835141,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:08.465622 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-25c23e1b-adf8-48c1-9469-6250963ceb4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:09.613515 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:10.842413 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:11.705206 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:12.130748 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:12.351185 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:30:15.151551 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37564) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:15.254542 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b84726f-18da-4f8d-aa0f-c76f0bd8167d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.329207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b84726f-18da-4f8d-aa0f-c76f0bd8167d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.385075 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6b84726f-18da-4f8d-aa0f-c76f0bd8167d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.426814 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-6b84726f-18da-4f8d-aa0f-c76f0bd8167d admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=e319e1a2b85d488aa960ea18be1c2736&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2741723 Nov 11 14:30:15.427824 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b84726f-18da-4f8d-aa0f-c76f0bd8167d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb00328d-1ccf-4040-891c-f88098ea742c,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:15.429792 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37568) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:15.478864 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.500410 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.596432 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.599242 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:15.600402 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/eb00328d-1ccf-4040-891c-f88098ea742c HTTP/1.1" status: 204 len: 168 time: 0.1695743 Nov 11 14:30:15.611570 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0d50cc-8c16-4f05-b7b7-c01563560f3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb00328d-1ccf-4040-891c-f88098ea742c,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:16.257267 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37592) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:16.270993 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dc9d0bd8-f7cd-4a84-be4e-745ae86563ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.336547 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25df7a21-f35e-44eb-8318-c6ec4da163d0 req-19296c3f-2fa9-4ff1-934a-f705f5d10226 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:16.338121 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-25df7a21-f35e-44eb-8318-c6ec4da163d0 req-19296c3f-2fa9-4ff1-934a-f705f5d10226 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0651391 Nov 11 14:30:16.347947 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dc9d0bd8-f7cd-4a84-be4e-745ae86563ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.385301 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-25df7a21-f35e-44eb-8318-c6ec4da163d0 req-df1814c2-8e48-4960-b341-5e9ff1c2c277 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410981 Nov 11 14:30:16.392777 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-dc9d0bd8-f7cd-4a84-be4e-745ae86563ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.436316 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-dc9d0bd8-f7cd-4a84-be4e-745ae86563ad admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=7fada92b49794225a4db48fd82b6a811&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1754978 Nov 11 14:30:16.436316 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc9d0bd8-f7cd-4a84-be4e-745ae86563ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48d76bdc-ab9f-42f5-831c-b06b6c58a492,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:16.437683 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37594) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:16.491247 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.517386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.630900 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.634143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:16.635347 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/48d76bdc-ab9f-42f5-831c-b06b6c58a492 HTTP/1.1" status: 204 len: 168 time: 0.1965110 Nov 11 14:30:16.643719 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c58113-a438-4601-9fe1-dc1845125452 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48d76bdc-ab9f-42f5-831c-b06b6c58a492,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:17.509783 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bcec4-b801-41bb-bb72-d376d0d893dd req-30c055b7-dc7b-4be2-9e37-18b4ac79f13f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:17.511253 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3b4bcec4-b801-41bb-bb72-d376d0d893dd req-30c055b7-dc7b-4be2-9e37-18b4ac79f13f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0496819 Nov 11 14:30:17.559046 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3b4bcec4-b801-41bb-bb72-d376d0d893dd req-a3067de1-d3ee-4e62-ab62-5bcbd0d2ecf0 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417452 Nov 11 14:30:18.684288 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58159607-66bf-42c7-9d4f-87239eedd0fc req-45f14501-0a1c-491a-b51e-b4b4fef38672 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:18.685768 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-58159607-66bf-42c7-9d4f-87239eedd0fc req-45f14501-0a1c-491a-b51e-b4b4fef38672 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0560870 Nov 11 14:30:18.734959 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-58159607-66bf-42c7-9d4f-87239eedd0fc req-314ac2c1-60fc-454a-8b2c-00b92e0c8865 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432465 Nov 11 14:30:19.017378 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37652) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:19.124248 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ca237bcb-c0f5-4848-83db-b7bacb490d39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.196137 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ca237bcb-c0f5-4848-83db-b7bacb490d39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.270230 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ca237bcb-c0f5-4848-83db-b7bacb490d39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.308757 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ca237bcb-c0f5-4848-83db-b7bacb490d39 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=bed36dbfe50348c58ff53a4d453e8fd8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2901042 Nov 11 14:30:19.309600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca237bcb-c0f5-4848-83db-b7bacb490d39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b1f8b7c-ff06-4792-ba71-757f11b95edc,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:19.311498 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37656) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:19.361487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.383049 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.533413 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.535990 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:19.537134 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/7b1f8b7c-ff06-4792-ba71-757f11b95edc HTTP/1.1" status: 204 len: 168 time: 0.2246654 Nov 11 14:30:19.545271 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d675561-f292-458e-8beb-b317e5e5a301 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b1f8b7c-ff06-4792-ba71-757f11b95edc,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:19.857070 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0012585-5799-4131-879d-7ab52e0c0be9 req-009466cc-6e2a-4712-8099-9125092a31bd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:19.858528 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0012585-5799-4131-879d-7ab52e0c0be9 req-009466cc-6e2a-4712-8099-9125092a31bd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0526884 Nov 11 14:30:19.906373 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b0012585-5799-4131-879d-7ab52e0c0be9 req-e73785c3-4a02-4a3b-b9d4-970cbfc85627 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418131 Nov 11 14:30:20.063782 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37664) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:20.076692 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8796ccd8-9638-4b87-b811-85173809b450 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.149404 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8796ccd8-9638-4b87-b811-85173809b450 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.223522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8796ccd8-9638-4b87-b811-85173809b450 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.262222 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8796ccd8-9638-4b87-b811-85173809b450 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=68c52b121d3b468fae25d3b91def157f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1973891 Nov 11 14:30:20.263095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8796ccd8-9638-4b87-b811-85173809b450 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=554e72fe-b942-46b8-9606-58caaeb13276,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:20.264908 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37666) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:20.314252 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.339270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.476592 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.479211 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:20.480389 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/554e72fe-b942-46b8-9606-58caaeb13276 HTTP/1.1" status: 204 len: 168 time: 0.2137077 Nov 11 14:30:20.488550 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0474ceb3-8bc0-41dc-b76e-560874a8d672 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=554e72fe-b942-46b8-9606-58caaeb13276,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:21.035737 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48b5fb6-af15-4f3b-9628-f80da199062d req-bb46075c-3c17-42f5-afd4-6204d12e63ea tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:21.038586 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d48b5fb6-af15-4f3b-9628-f80da199062d req-bb46075c-3c17-42f5-afd4-6204d12e63ea tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0562258 Nov 11 14:30:21.088188 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d48b5fb6-af15-4f3b-9628-f80da199062d req-9461b602-4faf-43e4-bd1c-416f6bb0185a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409598 Nov 11 14:30:22.210208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4062ad7f-7bd7-40e5-9c3c-facc8b88f5c3 req-7091b5f3-a8e3-48ce-8a29-4f85f90efd9d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:22.211694 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4062ad7f-7bd7-40e5-9c3c-facc8b88f5c3 req-7091b5f3-a8e3-48ce-8a29-4f85f90efd9d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0503249 Nov 11 14:30:22.263683 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4062ad7f-7bd7-40e5-9c3c-facc8b88f5c3 req-9fde57f2-6a1f-48c0-8763-deaf2ce7a868 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458353 Nov 11 14:30:23.383188 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7525a3-5254-4606-a859-09dd22e746e3 req-a7109d1c-7231-493d-8102-d443b5ea705b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:23.384786 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8a7525a3-5254-4606-a859-09dd22e746e3 req-a7109d1c-7231-493d-8102-d443b5ea705b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0492516 Nov 11 14:30:23.434832 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8a7525a3-5254-4606-a859-09dd22e746e3 req-82b2c5fc-a8ec-487d-8d24-b472be1b93ea tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435996 Nov 11 14:30:24.550983 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa0c353-7970-4fec-9e01-74ad1fc0fa02 req-eb6489e1-4d04-477f-9b09-fad12b01f147 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:24.552997 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3aa0c353-7970-4fec-9e01-74ad1fc0fa02 req-eb6489e1-4d04-477f-9b09-fad12b01f147 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0487318 Nov 11 14:30:24.598722 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3aa0c353-7970-4fec-9e01-74ad1fc0fa02 req-d4a854b0-6b59-405d-8ef6-c354a071fb02 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400381 Nov 11 14:30:25.721272 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee59438a-4405-4b7b-ad0b-96fd56aca37a req-d3936a52-4977-4e3e-bf14-5de6cf82bd02 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:25.722742 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ee59438a-4405-4b7b-ad0b-96fd56aca37a req-d3936a52-4977-4e3e-bf14-5de6cf82bd02 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0519588 Nov 11 14:30:25.772875 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ee59438a-4405-4b7b-ad0b-96fd56aca37a req-c4ba0c92-cd00-4720-bb8d-f27bdf98562b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436246 Nov 11 14:30:26.889022 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3209d521-bb4d-4cf9-b881-785a2e485d46 req-90026c7a-0059-41ab-ace0-ca2e542cc469 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:26.890494 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3209d521-bb4d-4cf9-b881-785a2e485d46 req-90026c7a-0059-41ab-ace0-ca2e542cc469 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0473559 Nov 11 14:30:26.939619 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3209d521-bb4d-4cf9-b881-785a2e485d46 req-f7018c68-8202-4386-b114-2813d0b5e252 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418961 Nov 11 14:30:28.060424 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd4b742-fa1d-46cf-9f5e-f51fdaf63f7f req-33651e2e-ac27-4b42-955f-f754041c3483 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:28.061421 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fd4b742-fa1d-46cf-9f5e-f51fdaf63f7f req-33651e2e-ac27-4b42-955f-f754041c3483 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0492446 Nov 11 14:30:28.108115 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fd4b742-fa1d-46cf-9f5e-f51fdaf63f7f req-ffcfc178-1bb2-4159-ba82-d812622c3841 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406806 Nov 11 14:30:29.232961 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f59905f-2793-40b9-b284-416ebe5dda8e req-6b3c5dc9-6abb-436d-849b-de961a0ef951 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:29.234533 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2f59905f-2793-40b9-b284-416ebe5dda8e req-6b3c5dc9-6abb-436d-849b-de961a0ef951 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0516832 Nov 11 14:30:29.281069 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2f59905f-2793-40b9-b284-416ebe5dda8e req-873f0d2f-a33c-4b8d-84a9-c983c06e5688 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407445 Nov 11 14:30:30.409891 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a5419c-d77b-46e5-8323-e1fcd7b86266 req-2fb294ff-4815-4578-a0af-3316df4df33d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:30.411333 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-53a5419c-d77b-46e5-8323-e1fcd7b86266 req-2fb294ff-4815-4578-a0af-3316df4df33d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0550048 Nov 11 14:30:30.463735 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-53a5419c-d77b-46e5-8323-e1fcd7b86266 req-64246ac7-485b-4130-b978-9a43dd7e784d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462823 Nov 11 14:30:31.591901 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cfd68e-8eb5-40e9-b6f5-0ba42095aca6 req-2c5c9db3-cd42-4fdd-8d3f-ed2a492dc8a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:31.596421 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-53cfd68e-8eb5-40e9-b6f5-0ba42095aca6 req-2c5c9db3-cd42-4fdd-8d3f-ed2a492dc8a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0536218 Nov 11 14:30:31.651467 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-53cfd68e-8eb5-40e9-b6f5-0ba42095aca6 req-109b8892-f8f4-4806-a911-9b10731b6686 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453408 Nov 11 14:30:31.697229 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37806) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:31.805072 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e3fedbc-5fbb-4e1f-91cf-59599914ff73 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:31.878776 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e3fedbc-5fbb-4e1f-91cf-59599914ff73 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:31.922017 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7e3fedbc-5fbb-4e1f-91cf-59599914ff73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:31.960622 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7e3fedbc-5fbb-4e1f-91cf-59599914ff73 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c0ba3331474b4917a5fc067bdf75973b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2622883 Nov 11 14:30:31.962606 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3fedbc-5fbb-4e1f-91cf-59599914ff73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26e1116f-0c6d-4b39-873a-49db09155fde,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:31.967460 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37810) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:32.015511 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.040628 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.155086 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.157791 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.158936 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/26e1116f-0c6d-4b39-873a-49db09155fde HTTP/1.1" status: 204 len: 168 time: 0.1945078 Nov 11 14:30:32.168670 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d455287-65f0-4dff-bc47-c8f2684a1f9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26e1116f-0c6d-4b39-873a-49db09155fde,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:32.734423 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37818) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:32.754641 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-aaa8cced-8e96-443e-8363-f140a4fa5884 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.792224 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632373fd-2210-4c51-baec-cec948ff3d8e req-e5f6251f-2318-492a-8d88-4589373f34ee tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:32.796092 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-632373fd-2210-4c51-baec-cec948ff3d8e req-e5f6251f-2318-492a-8d88-4589373f34ee tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0626564 Nov 11 14:30:32.848340 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-aaa8cced-8e96-443e-8363-f140a4fa5884 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.857356 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-632373fd-2210-4c51-baec-cec948ff3d8e req-f32d7b24-3c58-4512-9f42-7cc9d37d4066 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549552 Nov 11 14:30:32.910624 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-aaa8cced-8e96-443e-8363-f140a4fa5884 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:32.950542 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-aaa8cced-8e96-443e-8363-f140a4fa5884 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d39c57a7e7c04c8a8d5b0f088ab10cd7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2141852 Nov 11 14:30:32.951170 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa8cced-8e96-443e-8363-f140a4fa5884 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a89d62e-3264-41bc-9b20-0424d33e45ad,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:32.953378 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37820) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:33.005299 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.026954 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.156084 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.158824 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.160058 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/8a89d62e-3264-41bc-9b20-0424d33e45ad HTTP/1.1" status: 204 len: 168 time: 0.2056966 Nov 11 14:30:33.169545 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1f6d62-e7fa-4008-b6a3-a880ad8b5a80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a89d62e-3264-41bc-9b20-0424d33e45ad,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:33.814528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37826) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:33.828146 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a900c558-8ac1-4271-9f59-55c8cc526833 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.903067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a900c558-8ac1-4271-9f59-55c8cc526833 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.982737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa8ca67-3178-4962-8bb5-7f857801862e req-9ceb8f9c-1ba9-47ca-bbc9-06dae0fd9460 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:33.987071 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a900c558-8ac1-4271-9f59-55c8cc526833 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:33.988280 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dfa8ca67-3178-4962-8bb5-7f857801862e req-9ceb8f9c-1ba9-47ca-bbc9-06dae0fd9460 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0536292 Nov 11 14:30:34.025656 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a900c558-8ac1-4271-9f59-55c8cc526833 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=1acde9b0051b476db620a90f30d10272&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2100546 Nov 11 14:30:34.028234 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37830) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:34.038937 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a900c558-8ac1-4271-9f59-55c8cc526833 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83c9e0b3-0be4-4ec3-a8d4-9f960936d300,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:34.062869 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dfa8ca67-3178-4962-8bb5-7f857801862e req-764036ed-ca5b-462c-b7b3-bae9f2db8680 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0694184 Nov 11 14:30:34.094984 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.118801 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.242824 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.245422 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.248939 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/83c9e0b3-0be4-4ec3-a8d4-9f960936d300 HTTP/1.1" status: 204 len: 168 time: 0.2171831 Nov 11 14:30:34.260046 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b054ac21-c07a-4704-9591-9db609676000 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83c9e0b3-0be4-4ec3-a8d4-9f960936d300,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:34.582742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:30:34.695454 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:34.706935 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:30:34.756300 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.775972 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:30:34.798437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:34.887858 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:34.955972 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=6']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:34.970805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:30:34.977590 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.978680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.978680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.978930 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.979325 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.980019 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.980450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.981000 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.981299 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.981718 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.982139 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:34.984303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:35.351233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79307789-15ee-4f98-b574-90d0f325dc89 req-c1dc4103-4836-467e-9c69-960467ff2a68 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:35.351233 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-79307789-15ee-4f98-b574-90d0f325dc89 req-c1dc4103-4836-467e-9c69-960467ff2a68 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 944 time: 0.0948734 Nov 11 14:30:35.375074 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-79307789-15ee-4f98-b574-90d0f325dc89 req-caa77779-6de4-4a4c-b3b7-601c2057ff17 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722947 Nov 11 14:30:35.598368 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37882) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:35.743278 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-71527190-network', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:35.853180 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Made reservation on behalf of 8cac4cebe6754e1a9f7a0dc1d0714835 for: {'network': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:30:35.855620 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:35.877016 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:35.979707 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.048074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b69e7069-bcc7-437f-907e-8299a6f5d53e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.076478 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.120038 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102268) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:30:36.133829 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2abd799-9f34-47aa-b5d5-7c94b4c3a8f6,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:36.145120 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.145486 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.segments_db [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Added segment cb3037f5-86ce-4286-bbcf-8752577b0c73 of type vlan for network 423f335f-df68-4380-9f3a-d51e1811cc79 Nov 11 14:30:36.201613 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.288951 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.289989 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:36.290602 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.372355 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] Pushing event updated for resources: {'Network': ['ID=423f335f-df68-4380-9f3a-d51e1811cc79,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:36.392142 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 423f335f-df68-4380-9f3a-d51e1811cc79 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:30:36.467672 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b2974387-3153-4efe-8e5c-ef546b515312 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.8640559 Nov 11 14:30:36.470644 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37888) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:36.479892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Request body: {'subnet': {'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-71527190-subnet', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:36.560036 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0258cf-0af9-4acf-8024-cda9ed2fa408 req-a61b0bbb-1a52-4bc9-90c8-d5262d4f20af tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:36.563497 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2d0258cf-0af9-4acf-8024-cda9ed2fa408 req-a61b0bbb-1a52-4bc9-90c8-d5262d4f20af tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 944 time: 0.0947855 Nov 11 14:30:36.576944 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:36.596880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Made reservation on behalf of 8cac4cebe6754e1a9f7a0dc1d0714835 for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:30:36.600758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.633680 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2d0258cf-0af9-4acf-8024-cda9ed2fa408 req-4d7a87d7-afd3-492b-b5c6-c087b19fdd3a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631604 Nov 11 14:30:36.666333 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:36.666992 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.775660 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.806477 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:30:36.810698 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22ef5214-db9e-41c8-b4ac-e43a7d50b687" -d '{"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:30:36.851674 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:36.871227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:30:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7085b3b9-5971-48eb-9a97-c82bbbb42e36 x-openstack-request-id: req-7085b3b9-5971-48eb-9a97-c82bbbb42e36 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:30:36.871227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:30:36.871227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-7085b3b9-5971-48eb-9a97-c82bbbb42e36 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:30:36.871227 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'code': 200} Nov 11 14:30:36.916931 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.950181 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:36.991305 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=7']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:37.031224 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:37.039280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Checking segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:37.039674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Network hostable DHCP agents. Network: 423f335f-df68-4380-9f3a-d51e1811cc79, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:30:37.167572 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Network 423f335f-df68-4380-9f3a-d51e1811cc79 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:30:37.270801 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 423f335f-df68-4380-9f3a-d51e1811cc79) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:37.275330 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:37.282489 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.284717 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85535daf-3bae-449f-98dd-2078d4a725dd None None] Network 423f335f-df68-4380-9f3a-d51e1811cc79 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:30:37.372997 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37892) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:37.373238 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-cf606282-60ef-499c-b11b-688beb33fd67 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 0.9007518 Nov 11 14:30:37.383234 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:37.488122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-423f335f-df68-4380-9f3a-d51e1811cc79', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:30:37.489293 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.545434 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.546600 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.652429 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.675954 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Allocated IP 172.20.0.2 (423f335f-df68-4380-9f3a-d51e1811cc79/0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72/96d6960e-f5a0-46c1-b19c-7fa0038487d9) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:37.912757 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.946932 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:37.966129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5c22b3-3a5b-4808-ade0-1429183eacd0 req-56b418f1-d0b4-46cd-8a64-919e530e7ce3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:37.977606 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb5c22b3-3a5b-4808-ade0-1429183eacd0 req-56b418f1-d0b4-46cd-8a64-919e530e7ce3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.2003486 Nov 11 14:30:37.993401 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.051339 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Network 423f335f-df68-4380-9f3a-d51e1811cc79 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:38.056317 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb5c22b3-3a5b-4808-ade0-1429183eacd0 req-b29ec81e-0718-46ca-9944-de59551f9e15 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741596 Nov 11 14:30:38.056574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:38.061892 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:38.118214 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Pushing event updated for resources: {'Port': ['ID=96d6960e-f5a0-46c1-b19c-7fa0038487d9,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:38.173221 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Attempting to bind port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:38.173588 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Attempting to bind port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:38.174000 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Attempting to bind port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 on network 423f335f-df68-4380-9f3a-d51e1811cc79 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:38.186426 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:38.186839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Checking segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:38.189365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.189365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Bound using segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:38.189365 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Bound port: 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:38.200784 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.280362 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] For port 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:38.283984 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] For port 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96d6960e-f5a0-46c1-b19c-7fa0038487d9,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:38.353388 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.373351 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.485240 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Allocated IP 172.27.1.191 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/e890221d-39e7-4706-8680-f1ff9d15b0f2) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:38.597625 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.797421 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.820174 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.826471 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-79cd0646-7fcf-4e52-9c15-f00ecd72822c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:38.871445 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d42a1e3-4358-4037-9bcd-739b3a4e41c1 None None] Pushing event updated for resources: {'Port': ['ID=96d6960e-f5a0-46c1-b19c-7fa0038487d9,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:38.892574 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:38.897350 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:38.906994 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:38.944101 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Pushing event updated for resources: {'Port': ['ID=e890221d-39e7-4706-8680-f1ff9d15b0f2,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:39.260302 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d8d3259-8031-4568-a8fb-e467ca595821 req-eb88916e-08df-40e4-8b68-bef69003b692 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:39.269410 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d8d3259-8031-4568-a8fb-e467ca595821 req-eb88916e-08df-40e4-8b68-bef69003b692 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0897572 Nov 11 14:30:39.385717 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d8d3259-8031-4568-a8fb-e467ca595821 req-498159c4-8641-47b1-9e25-957c92754465 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1153507 Nov 11 14:30:39.463949 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:39.649463 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:39.733934 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:39.991049 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Router d633719b-30dc-4e87-97ff-8877f6c9e64b is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:30:40.167229 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:30:40.176537 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Sync routers for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:30:40.203563 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:40.204582 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:40.206762 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1c39470-b723-4f4c-a863-859fa2538782 None None] Network 423f335f-df68-4380-9f3a-d51e1811cc79 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:30:40.297332 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:40.299414 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-82608839-4d0a-44b1-9f8c-da94dde34252 admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.9230876 Nov 11 14:30:40.301202 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37902) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:40.334334 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96d6960e-f5a0-46c1-b19c-7fa0038487d9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:40.455088 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-b5f8f3ae-fa33-4403-8cde-31a9ccc3767a None None] Provisioning complete for port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:40.456346 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b5f8f3ae-fa33-4403-8cde-31a9ccc3767a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:40.469278 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:40.470575 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:40.561714 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:40.899300 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91adcaf-caa7-4db1-8d97-03dcf8bce5fb req-b61aeb78-0227-439a-90e2-36c7e2575227 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:40.900770 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d91adcaf-caa7-4db1-8d97-03dcf8bce5fb req-b61aeb78-0227-439a-90e2-36c7e2575227 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.1357112 Nov 11 14:30:40.974003 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.024078 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d91adcaf-caa7-4db1-8d97-03dcf8bce5fb req-a769908e-3c3b-4df5-b19c-a0d23815759e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1039441 Nov 11 14:30:41.043742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.050778 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b5f8f3ae-fa33-4403-8cde-31a9ccc3767a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.183228 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96d6960e-f5a0-46c1-b19c-7fa0038487d9,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:41.204236 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:39Z', 'revision_number': 3, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:41.242841 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Checking router: d633719b-30dc-4e87-97ff-8877f6c9e64b for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:30:41.243248 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Updating router d633719b-30dc-4e87-97ff-8877f6c9e64b port e890221d-39e7-4706-8680-f1ff9d15b0f2 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:30:41.279068 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.353624 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.441100 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.db.api [None req-b5f8f3ae-fa33-4403-8cde-31a9ccc3767a None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102269) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 11 14:30:41.441955 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG oslo_db.api [None req-b5f8f3ae-fa33-4403-8cde-31a9ccc3767a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 11 14:30:41.529630 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.592936 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=96d6960e-f5a0-46c1-b19c-7fa0038487d9,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:41.746830 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.791767 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Allocated IP 172.20.0.1 (423f335f-df68-4380-9f3a-d51e1811cc79/0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72/5458d736-0c70-4a69-a8fe-2619fa5dc5a3) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:41.857212 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:41.948537 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.006959 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.089327 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.111009 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Attempting to bind port e890221d-39e7-4706-8680-f1ff9d15b0f2 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:42.112098 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Attempting to bind port e890221d-39e7-4706-8680-f1ff9d15b0f2 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:42.113924 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Attempting to bind port e890221d-39e7-4706-8680-f1ff9d15b0f2 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:42.151238 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:42.152002 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:42.152472 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.152894 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:42.153437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Bound port: e890221d-39e7-4706-8680-f1ff9d15b0f2, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:42.153862 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.167153 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Network 423f335f-df68-4380-9f3a-d51e1811cc79 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:42.171274 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:42.177308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:42.207907 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Pushing event updated for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:42.237308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.354113 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6807d5cc-471a-4f85-b66e-5b4c40843394 req-8c883992-8878-4a27-85ce-869e7f77551e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:42.362578 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6807d5cc-471a-4f85-b66e-5b4c40843394 req-8c883992-8878-4a27-85ce-869e7f77551e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.2062428 Nov 11 14:30:42.384145 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef2bdbf-b319-47e8-aecf-51ced1e51519 None None] Pushing event updated for resources: {'Port': ['ID=e890221d-39e7-4706-8680-f1ff9d15b0f2,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:42.417046 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96d6960e-f5a0-46c1-b19c-7fa0038487d9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:42.424935 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.428843 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] For port e890221d-39e7-4706-8680-f1ff9d15b0f2, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:42.467164 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6807d5cc-471a-4f85-b66e-5b4c40843394 req-cd903103-0e91-4068-8834-5680765aa1da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803416 Nov 11 14:30:42.508852 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.514130 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-2592313a-2ee8-4347-8962-56d18f3fa5fa None None] Provisioning complete for port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:42.514614 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2592313a-2ee8-4347-8962-56d18f3fa5fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.591150 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] For port e890221d-39e7-4706-8680-f1ff9d15b0f2, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=e890221d-39e7-4706-8680-f1ff9d15b0f2,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:42.671058 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.672912 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:42.673271 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.780408 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:42.781177 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:42.821107 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef2bdbf-b319-47e8-aecf-51ced1e51519 None None] Pushing event updated for resources: {'Port': ['ID=e890221d-39e7-4706-8680-f1ff9d15b0f2,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:42.938090 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-4abf9350-cb7a-41cf-822d-4b1b0fe53f76 None None] Provisioning complete for port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:42.938450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4abf9350-cb7a-41cf-822d-4b1b0fe53f76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.944421 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:42.964961 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:43.011395 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-4abf9350-cb7a-41cf-822d-4b1b0fe53f76 None None] Port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:30:43.011997 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:43.100525 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Pushing event updated for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:43.108485 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:43.228300 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Network 423f335f-df68-4380-9f3a-d51e1811cc79 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:43.229777 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:43.236719 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:41Z', 'revision_number': 1, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:43.287580 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21217709-188c-4faa-83b1-2d43a09f82c5 None None] The sync data for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi is: [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:41Z', 'revision_number': 1, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:30:43.401514 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Router d633719b-30dc-4e87-97ff-8877f6c9e64b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:30:43.530528 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-b03f023f-2d48-4c73-9a81-74cefc599a51 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0548217 Nov 11 14:30:43.555848 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-a9b80713-fee0-48b6-bc74-5765a79aeaa6 None None] Provisioning complete for port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:43.556419 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a9b80713-fee0-48b6-bc74-5765a79aeaa6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:43.613315 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:30:43.619168 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1efb3813-6c8a-47a8-86d5-ed1f2d98466d admin admin] 10.222.0.10 "PUT /v2.0/routers/d633719b-30dc-4e87-97ff-8877f6c9e64b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3168232 Nov 11 14:30:43.687699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210d15b5-7ca7-46ef-9079-142aac065061 req-e0b93184-9bb9-4dde-8126-b36b05cb9e65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:43.689126 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-e0b93184-9bb9-4dde-8126-b36b05cb9e65 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1098 time: 0.1070530 Nov 11 14:30:43.693250 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-a9b80713-fee0-48b6-bc74-5765a79aeaa6 None None] Port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:30:43.792815 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc39730-1ffd-483c-96d1-160386167931 req-2153ae5d-9240-406b-aec3-921cb9941811 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:43.794707 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cfc39730-1ffd-483c-96d1-160386167931 req-2153ae5d-9240-406b-aec3-921cb9941811 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0789640 Nov 11 14:30:43.861483 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cfc39730-1ffd-483c-96d1-160386167931 req-3a2a6ba1-4446-41d6-9b5e-d119cc5a2b38 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0577981 Nov 11 14:30:43.870934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210d15b5-7ca7-46ef-9079-142aac065061 req-9b587b43-f229-48da-8f74-25918ae286d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:43.872462 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-9b587b43-f229-48da-8f74-25918ae286d2 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.1542044 Nov 11 14:30:43.972943 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-7a532f5c-eb58-4db3-ae60-cf54f5d103f8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 1001 time: 0.0902982 Nov 11 14:30:44.057731 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210d15b5-7ca7-46ef-9079-142aac065061 req-04479a6a-6af5-4d97-bb1a-c8f520417794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:44.058961 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-04479a6a-6af5-4d97-bb1a-c8f520417794 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0788627 Nov 11 14:30:44.157372 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210d15b5-7ca7-46ef-9079-142aac065061 req-07898616-e4ab-4593-8a2e-34de1c68514f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:44.159338 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-07898616-e4ab-4593-8a2e-34de1c68514f service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0925059 Nov 11 14:30:44.325242 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-e62fdc8b-f9d8-4ee2-998f-9a9d9ba61f1e service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1512592 Nov 11 14:30:44.438874 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-210d15b5-7ca7-46ef-9079-142aac065061 req-574477db-6f23-4f57-9c70-d950edf23de1 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1072109 Nov 11 14:30:45.050831 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4324b00-2442-482e-aedd-c6fde8254719 req-b471aa03-3dd6-42e5-a08e-26d89cac5be5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:45.052972 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b4324b00-2442-482e-aedd-c6fde8254719 req-b471aa03-3dd6-42e5-a08e-26d89cac5be5 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0860112 Nov 11 14:30:45.062347 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37932) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:45.076541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1737394267-network', 'tenant_id': 'd718788844474b4099772cec122606af'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:45.143662 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b4324b00-2442-482e-aedd-c6fde8254719 req-d2249f71-ab9f-46b1-8e76-70dc836b67dd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840373 Nov 11 14:30:45.185895 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Made reservation on behalf of d718788844474b4099772cec122606af for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:30:45.190029 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.200102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.310706 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.361784 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.392069 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d5dc671-ff0f-4187-844b-d29eea80be89,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:45.411355 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 320} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:30:45.431852 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.431852 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Added segment 001ac1d6-3e42-4f39-95e5-7a46d080774e of type vlan for network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 Nov 11 14:30:45.487909 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.585654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.586907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:45.587939 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.665862 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] Pushing event updated for resources: {'Network': ['ID=5e23d4c0-3fc9-4c3d-bd31-5197b9354e62,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:45.677024 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:30:45.685661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37934) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:45.687336 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-cf1373b6-1f32-4a62-89dd-6b1c2fbbb66d admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6165767 Nov 11 14:30:45.690880 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Request body: {'subnet': {'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1737394267-subnet', 'tenant_id': 'd718788844474b4099772cec122606af', 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:45.790365 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Made reservation on behalf of d718788844474b4099772cec122606af for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:30:45.792995 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-129288590'] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:45.888151 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Sync routers for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:30:45.904139 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:45.905186 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:46.028376 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:46.048087 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-125906361', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-129288608'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.120395 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Checking segment: {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:46.120720 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Network hostable DHCP agents. Network: 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:30:46.126142 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Pushing event updated for resources: {'Subnet': ['ID=027d6a5f-872b-491e-8dc5-e75bc4d5bf2d,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:46.230630 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:30:46.304022 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device e890221d-39e7-4706-8680-f1ff9d15b0f2 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:46.331117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca41dc9c-ac75-4a5a-a52d-c02e78164ab1 req-e46936ef-20eb-4dd1-921e-23491e1e07a4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:46.333297 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ca41dc9c-ac75-4a5a-a52d-c02e78164ab1 req-e46936ef-20eb-4dd1-921e-23491e1e07a4 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0726416 Nov 11 14:30:46.347563 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:46.357193 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fcfb71f-c2fc-4150-a41e-32cf3dc986cb None None] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:30:46.361016 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:46.361772 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.415758 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ca41dc9c-ac75-4a5a-a52d-c02e78164ab1 req-014bdd57-6f0b-430f-8bf3-82e68e0ef9a1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0752804 Nov 11 14:30:46.423128 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 2, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:46.440327 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port e890221d-39e7-4706-8680-f1ff9d15b0f2 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:46.441035 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.451844 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-94011e71-2c5d-4541-a30d-763d8d05f723 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7641838 Nov 11 14:30:46.461162 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37938) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:46.465944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:46.472058 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Checking router: d633719b-30dc-4e87-97ff-8877f6c9e64b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:30:46.472410 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Updating router d633719b-30dc-4e87-97ff-8877f6c9e64b port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:30:46.513597 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.591032 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.593982 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.601088 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.620565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'tenant_id': 'd718788844474b4099772cec122606af', 'fixed_ips': [{'subnet_id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:30:46.622510 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.654218 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port e890221d-39e7-4706-8680-f1ff9d15b0f2, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=e890221d-39e7-4706-8680-f1ff9d15b0f2,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:46.699586 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.734989 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.834969 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=e890221d-39e7-4706-8680-f1ff9d15b0f2,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:46.843393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Allocated IP 172.20.0.2 (5e23d4c0-3fc9-4c3d-bd31-5197b9354e62/027d6a5f-872b-491e-8dc5-e75bc4d5bf2d/ba8761f1-e519-497e-b3ea-252822e2d328) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:46.877809 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.953108 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:46.982079 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.008221 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Pushing event updated for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:47.029304 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.030226 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.030226 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.030424 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.030677 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.031057 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.031399 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.031736 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.032418 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.032750 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.033135 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.033444 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:30:47.105160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.148909 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Attempting to bind port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:47.149380 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Attempting to bind port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:47.149670 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Attempting to bind port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 on network 423f335f-df68-4380-9f3a-d51e1811cc79 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:47.155019 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:47.155432 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Checking segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:47.155831 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.156216 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Bound using segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:47.156718 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Bound port: 5458d736-0c70-4a69-a8fe-2619fa5dc5a3, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:47.157104 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.202385 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.278947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:47.284740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:47.285313 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] For port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:47.288892 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:47.296085 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] For port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:47.298381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Pushing event updated for resources: {'Port': ['ID=ba8761f1-e519-497e-b3ea-252822e2d328,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:47.352463 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.365942 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Attempting to bind port ba8761f1-e519-497e-b3ea-252822e2d328 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:47.366436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Attempting to bind port ba8761f1-e519-497e-b3ea-252822e2d328 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:47.366677 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Attempting to bind port ba8761f1-e519-497e-b3ea-252822e2d328 on network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:47.373608 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:47.374141 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Checking segment: {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:47.374536 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.374930 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Bound using segment: {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:47.375426 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Bound port: ba8761f1-e519-497e-b3ea-252822e2d328, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:47.375821 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.378649 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.384467 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.478527 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:47.479160 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:47.550027 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Allocated IP 172.27.1.50 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/586db0b5-ecab-475d-9f81-49908f86ca54) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:47.550987 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6fd642-6fa6-4329-8c99-4985e06a8d96 None None] Pushing event updated for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=4']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:47.551896 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] For port ba8761f1-e519-497e-b3ea-252822e2d328, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:47.602754 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] Provisioning complete for port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:47.605275 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.635790 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51687b99-6d08-4851-bc76-a37f7a28771c req-94ba9393-a0a2-43c1-969a-e585f9b5aba2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:47.645868 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-51687b99-6d08-4851-bc76-a37f7a28771c req-94ba9393-a0a2-43c1-969a-e585f9b5aba2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.1007266 Nov 11 14:30:47.688840 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] For port ba8761f1-e519-497e-b3ea-252822e2d328, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ba8761f1-e519-497e-b3ea-252822e2d328,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:47.716797 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:47.764208 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-51687b99-6d08-4851-bc76-a37f7a28771c req-a9a27f98-3d3a-40c5-bda1-7dee87e4acdd tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1168914 Nov 11 14:30:47.799246 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.824417 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.826651 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.923641 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] For port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:47.925012 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8360ee40-354f-414f-81b4-456c6b98a2c3 None None] Pushing event updated for resources: {'Port': ['ID=ba8761f1-e519-497e-b3ea-252822e2d328,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:47.959399 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:47.984661 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:48.020950 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:48.026163 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:48.030911 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:48.034129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Pushing event updated for resources: {'Port': ['ID=586db0b5-ecab-475d-9f81-49908f86ca54,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:48.037460 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:48.080806 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f2206e-6340-4619-a833-4fecd72477ea None None] The sync data for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi is: [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:30:48.097937 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a7e59c-2647-4332-b305-be1f9ecf32d4 None None] Pushing event updated for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:48.132784 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-97fb2e5d-edde-4cde-95f7-29c251f5608d None None] Provisioning complete for port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:48.138704 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-97fb2e5d-edde-4cde-95f7-29c251f5608d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:48.530431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device e890221d-39e7-4706-8680-f1ff9d15b0f2 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:48.615047 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port e890221d-39e7-4706-8680-f1ff9d15b0f2 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:48.615440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:48.666008 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:48.749851 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ba8761f1-e519-497e-b3ea-252822e2d328 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:48.826351 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port ba8761f1-e519-497e-b3ea-252822e2d328 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:48.827191 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.024754 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.024754 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port ba8761f1-e519-497e-b3ea-252822e2d328, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ba8761f1-e519-497e-b3ea-252822e2d328,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:49.026208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.026208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee84418-f5e3-4ea2-88e1-8c8fca1af9f0 req-3038e08a-773e-4f03-84de-e1cb5476a2aa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:49.026208 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3ee84418-f5e3-4ea2-88e1-8c8fca1af9f0 req-3038e08a-773e-4f03-84de-e1cb5476a2aa tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.1205516 Nov 11 14:30:49.140948 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3ee84418-f5e3-4ea2-88e1-8c8fca1af9f0 req-570ed66f-4640-42bf-a875-9a89a9aeb410 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0938318 Nov 11 14:30:49.156158 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.158910 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:49.245892 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Router 69d016ef-6608-4cdc-9804-51ddd7d75b43 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102268) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:30:49.287399 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49174547-96f4-4611-930e-402d0442c468 None None] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:30:49.345228 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=ba8761f1-e519-497e-b3ea-252822e2d328,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:49.350152 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:30:49.395794 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:49.396197 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.436284 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-9a336f8a-f8c9-4b57-96b3-9b7b68cb08d3 None None] Provisioning complete for port ba8761f1-e519-497e-b3ea-252822e2d328 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:49.436738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-9a336f8a-f8c9-4b57-96b3-9b7b68cb08d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.651579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:30:49.673028 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Sync routers for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:30:49.685494 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:49.686184 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:49.723123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:49.728031 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37948) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:49.728605 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-5e74346c-b571-493f-b5eb-cc3cb28bddbb admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.2658124 Nov 11 14:30:49.841707 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:50.006532 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-bdd75e1c-01a8-4c2c-b10b-0be0f6f976f4 None None] Provisioning complete for port ba8761f1-e519-497e-b3ea-252822e2d328 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:50.007781 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-bdd75e1c-01a8-4c2c-b10b-0be0f6f976f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.265849 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ba8761f1-e519-497e-b3ea-252822e2d328 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:50.308887 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.325769 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:48Z', 'revision_number': 3, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:50.332241 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed0f197-96d9-44d5-844b-20aba35f237a req-18b08aeb-b945-45a1-a333-726a96af933c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:50.334245 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eed0f197-96d9-44d5-844b-20aba35f237a req-18b08aeb-b945-45a1-a333-726a96af933c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0808499 Nov 11 14:30:50.357804 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Checking router: 69d016ef-6608-4cdc-9804-51ddd7d75b43 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:30:50.358142 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Updating router 69d016ef-6608-4cdc-9804-51ddd7d75b43 port 586db0b5-ecab-475d-9f81-49908f86ca54 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:30:50.383060 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port ba8761f1-e519-497e-b3ea-252822e2d328 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:50.383440 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.405354 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.450360 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eed0f197-96d9-44d5-844b-20aba35f237a req-56d3c832-3de2-422d-a831-962b28e0dc7b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1085641 Nov 11 14:30:50.519914 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Allocated IP 172.20.0.1 (5e23d4c0-3fc9-4c3d-bd31-5197b9354e62/027d6a5f-872b-491e-8dc5-e75bc4d5bf2d/068b60f9-41f7-4bff-a739-8bc3dc2890c8) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:30:50.716071 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.801767 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.854687 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032fba51-043a-4447-bc60-532022e38cbb None None] Pushing event updated for resources: {'Port': ['ID=586db0b5-ecab-475d-9f81-49908f86ca54,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:50.855311 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.856912 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Attempting to bind port 586db0b5-ecab-475d-9f81-49908f86ca54 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:50.857273 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Attempting to bind port 586db0b5-ecab-475d-9f81-49908f86ca54 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:50.857650 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Attempting to bind port 586db0b5-ecab-475d-9f81-49908f86ca54 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:50.862943 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:50.863335 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:50.863724 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.864095 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:50.864548 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Bound port: 586db0b5-ecab-475d-9f81-49908f86ca54, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:50.865426 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.915212 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] For port 586db0b5-ecab-475d-9f81-49908f86ca54, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:50.918307 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] For port 586db0b5-ecab-475d-9f81-49908f86ca54, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=586db0b5-ecab-475d-9f81-49908f86ca54,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:50.928937 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:50.968998 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:50.973735 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:50.977245 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:30:50.979991 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.001411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Pushing event updated for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:51.022270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.045906 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:51.046546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:51.050354 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032fba51-043a-4447-bc60-532022e38cbb None None] Pushing event updated for resources: {'Port': ['ID=586db0b5-ecab-475d-9f81-49908f86ca54,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:51.175578 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:51.233563 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.298497 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-8cb1f1d4-158c-48a1-a3cb-14d4b46e10d6 None None] Provisioning complete for port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:51.298871 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8cb1f1d4-158c-48a1-a3cb-14d4b46e10d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.345823 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-8cb1f1d4-158c-48a1-a3cb-14d4b46e10d6 None None] Port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:30:51.395667 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a103a5d6-d090-4426-907f-119312bcd336 req-a96e072f-7915-4c7a-b58e-6086a4213853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:51.397749 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-a96e072f-7915-4c7a-b58e-6086a4213853 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1098 time: 0.0906270 Nov 11 14:30:51.408018 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:48Z', 'revision_number': 3, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:51.439398 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded8e4b-f307-4087-9167-6cff74af1f38 None None] The sync data for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi is: [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:48Z', 'revision_number': 3, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:30:51.484915 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.517333 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a103a5d6-d090-4426-907f-119312bcd336 req-cb3ad9df-917e-4c5d-9c5e-9b3e16153fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:51.518880 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-cb3ad9df-917e-4c5d-9c5e-9b3e16153fc6 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.1116142 Nov 11 14:30:51.582594 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.589560 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aced92ac-ec3a-461d-948e-e3963dd98927 req-d70f27c4-1df4-4ca9-b07f-b9e926649031 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:51.591076 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-aced92ac-ec3a-461d-948e-e3963dd98927 req-d70f27c4-1df4-4ca9-b07f-b9e926649031 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0524740 Nov 11 14:30:51.630167 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-c8c1e8a9-b086-4160-a9d1-628919b31855 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 1000 time: 0.1035550 Nov 11 14:30:51.642419 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-aced92ac-ec3a-461d-948e-e3963dd98927 req-79e3c8bd-ca5f-4d52-8adc-4491c4c20108 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444708 Nov 11 14:30:51.708188 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:51.717083 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Pushing event updated for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:51.735500 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a103a5d6-d090-4426-907f-119312bcd336 req-7cb85110-d2dc-41c4-91f4-38154cbb3583 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:51.736898 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-7cb85110-d2dc-41c4-91f4-38154cbb3583 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0983715 Nov 11 14:30:51.838439 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a103a5d6-d090-4426-907f-119312bcd336 req-b395f7c1-373a-4e59-a3b3-f6f1f23ae0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:51.839988 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-b395f7c1-373a-4e59-a3b3-f6f1f23ae0ad service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0925632 Nov 11 14:30:51.880239 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:30:51.883795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:30:52.019952 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-c6285ffd-a311-4839-a715-63b4c4b7606f service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1721799 Nov 11 14:30:52.100830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Router 69d016ef-6608-4cdc-9804-51ddd7d75b43 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:30:52.176958 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a103a5d6-d090-4426-907f-119312bcd336 req-c274a820-379e-435a-a8dd-a00526e6029a service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462846 Nov 11 14:30:52.180408 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-3e3f7f02-b6b7-47fa-a3ce-779aafd5a8e2 None None] Provisioning complete for port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:52.181957 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3e3f7f02-b6b7-47fa-a3ce-779aafd5a8e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.242265 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-3e3f7f02-b6b7-47fa-a3ce-779aafd5a8e2 None None] Port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:30:52.243096 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:30:52.248316 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-f841545a-d7b9-407e-89e1-7939d079c00e admin admin] 10.222.0.10 "PUT /v2.0/routers/69d016ef-6608-4cdc-9804-51ddd7d75b43/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5192792 Nov 11 14:30:52.290546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 586db0b5-ecab-475d-9f81-49908f86ca54 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:52.338363 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 586db0b5-ecab-475d-9f81-49908f86ca54 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:52.338722 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.420465 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.440792 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 586db0b5-ecab-475d-9f81-49908f86ca54, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=586db0b5-ecab-475d-9f81-49908f86ca54,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:52.532938 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.585672 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=586db0b5-ecab-475d-9f81-49908f86ca54,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:52.771783 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517f6c7e-d4f9-4fef-b971-11c944aa6d17 req-45b16bb2-4bf0-4a1f-aa0d-6c7ec2788ffc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:52.778802 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-517f6c7e-d4f9-4fef-b971-11c944aa6d17 req-45b16bb2-4bf0-4a1f-aa0d-6c7ec2788ffc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0554810 Nov 11 14:30:52.809309 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37972) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:52.814161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-101850944', 'description': 'tempest-secgroup-smoke-101850944 description', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:52.824566 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-517f6c7e-d4f9-4fef-b971-11c944aa6d17 req-52655d4a-fbcb-4a32-987d-3ce2cb69058f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449142 Nov 11 14:30:52.893549 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.959807 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:52.974441 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Sync routers for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:30:52.983950 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:52.984546 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:53.035933 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.065383 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroup': ['ID=83058885-fc82-4d17-843e-77fc2ba0dd4e,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:53.088762 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:53.140736 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.142395 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d726ae62-069b-4fe6-ae13-1367b477d216 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.3316469 Nov 11 14:30:53.145159 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37974) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:53.149516 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:53.240988 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.290973 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:51Z', 'revision_number': 4, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '068b60f9-41f7-4bff-a739-8bc3dc2890c8', 'name': '', 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'tenant_id': 'd718788844474b4099772cec122606af', 'mac_address': 'fa:16:3e:c3:f9:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:50Z', 'updated_at': '2021-11-11T14:30:51Z', 'revision_number': 2, 'project_id': 'd718788844474b4099772cec122606af', 'subnets': [{'id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:53.297090 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.320963 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Checking router: 69d016ef-6608-4cdc-9804-51ddd7d75b43 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:30:53.321309 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Updating router 69d016ef-6608-4cdc-9804-51ddd7d75b43 port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:30:53.345341 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.384049 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.399149 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f15a758a-6534-48ac-aa06-8ee6a11b6696,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:53.477299 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.478693 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-b9d96a45-b1b1-4157-ac91-4cea94febd3f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3324304 Nov 11 14:30:53.481132 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37976) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:53.490461 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:53.572170 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.601066 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.626061 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.698349 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.721392 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.737510 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=33a939ca-cf4a-4fc0-ac87-496605636b04,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:53.746740 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a6eb7c6-effe-4e5a-bee3-91b8d72531d8 None None] Pushing event updated for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:53.803077 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Attempting to bind port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:30:53.803475 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Attempting to bind port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:30:53.803835 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Attempting to bind port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 on network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:30:53.808970 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 30, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:30:53.809336 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Checking segment: {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:30:53.809759 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.810139 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Bound using segment: {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:30:53.810590 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Bound port: 068b60f9-41f7-4bff-a739-8bc3dc2890c8, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '001ac1d6-3e42-4f39-95e5-7a46d080774e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 320, 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:30:53.810984 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.833058 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.834075 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-c4ae68e8-690d-41fb-b08f-d78a07f4483b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3513646 Nov 11 14:30:53.836660 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37980) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:53.841296 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:53.886785 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] For port 068b60f9-41f7-4bff-a739-8bc3dc2890c8, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:30:53.890090 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] For port 068b60f9-41f7-4bff-a739-8bc3dc2890c8, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=068b60f9-41f7-4bff-a739-8bc3dc2890c8,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:30:53.963959 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.974006 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.988867 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] Provisioning complete for port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:53.990067 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:53.999343 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546d7049-2af6-4c7c-b346-a510fc3ceca1 req-170d55f0-ca79-4628-9d08-14bd589ed655 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:54.000959 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-546d7049-2af6-4c7c-b346-a510fc3ceca1 req-170d55f0-ca79-4628-9d08-14bd589ed655 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 945 time: 0.0898492 Nov 11 14:30:54.061715 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.074690 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-546d7049-2af6-4c7c-b346-a510fc3ceca1 req-14964f98-bf7e-4bf0-b435-150a3ca34f7d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0625820 Nov 11 14:30:54.092189 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.128376 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] For port 068b60f9-41f7-4bff-a739-8bc3dc2890c8, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=068b60f9-41f7-4bff-a739-8bc3dc2890c8,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:54.144648 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.150449 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a6eb7c6-effe-4e5a-bee3-91b8d72531d8 None None] Pushing event updated for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=4']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:54.157179 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:30:54.157179 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:30:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:54.167284 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61024dc6-05e0-4246-931e-76096279860a,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:54.200628 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.244304 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.245986 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-aac6b54a-2860-4965-98f0-480163f5f542 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4083383 Nov 11 14:30:54.257116 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 37984) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:54.261985 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:54.273563 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 586db0b5-ecab-475d-9f81-49908f86ca54 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:54.284672 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:30:54.301672 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbffb6c1-76fe-4124-94f9-2aaec1e80b63 None None] Pushing event updated for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:54.335414 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 586db0b5-ecab-475d-9f81-49908f86ca54 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:54.335786 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.372262 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.438184 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.445608 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-7cd90ba7-1e09-40df-9bbd-09c86faea1b5 None None] Provisioning complete for port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:54.445994 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7cd90ba7-1e09-40df-9bbd-09c86faea1b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.509025 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:51Z', 'revision_number': 4, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '068b60f9-41f7-4bff-a739-8bc3dc2890c8', 'name': '', 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'tenant_id': 'd718788844474b4099772cec122606af', 'mac_address': 'fa:16:3e:c3:f9:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:50Z', 'updated_at': '2021-11-11T14:30:53Z', 'revision_number': 4, 'project_id': 'd718788844474b4099772cec122606af', 'subnets': [{'id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:30:54.521446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.535515 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960f19c0-8abb-4577-b1d0-4649bd26158f None None] The sync data for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi is: [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:30:51Z', 'revision_number': 4, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '068b60f9-41f7-4bff-a739-8bc3dc2890c8', 'name': '', 'network_id': '5e23d4c0-3fc9-4c3d-bd31-5197b9354e62', 'tenant_id': 'd718788844474b4099772cec122606af', 'mac_address': 'fa:16:3e:c3:f9:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:50Z', 'updated_at': '2021-11-11T14:30:53Z', 'revision_number': 4, 'project_id': 'd718788844474b4099772cec122606af', 'subnets': [{'id': '027d6a5f-872b-491e-8dc5-e75bc4d5bf2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:30:54.540395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ac7586e6-b53c-419f-805a-68abae10084e,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:54.615892 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:30:54.620574 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.621803 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-aa015e12-3215-40c5-bdab-20c8701cbe48 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3634133 Nov 11 14:30:54.633827 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37986) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:54.641607 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:54.702988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.726590 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:30:54.728868 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a19597bc-969f-4ae5-ac80-c3345fa66769" -d '{"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-unplugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:30:54.743130 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.securitygroups_db [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Project 8cac4cebe6754e1a9f7a0dc1d0714835 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:30:54.746634 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:30:54.748710 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.764892 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 11 Nov 2021 14:30:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ea5b393-a891-42de-84c3-51201fb13c6d x-openstack-request-id: req-1ea5b393-a891-42de-84c3-51201fb13c6d {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:30:54.765181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-unplugged", "status": "failed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "code": 422}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:30:54.765434 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-1ea5b393-a891-42de-84c3-51201fb13c6d {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:30:54.765911 dv-cinder-777031-9-iscsi neutron-server[102269]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'code': 422} returned with failed status Nov 11 14:30:54.811201 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.823096 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.872146 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=8']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:54.903061 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:54.925380 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e29c550d-1928-41ce-b352-29d0a90a3e4f,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:55.002519 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:55.003764 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d968de42-1b9c-45d2-8d65-be0239234720 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3681126 Nov 11 14:30:55.006496 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 37990) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:55.010989 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'security_group_rule': {'security_group_id': '83058885-fc82-4d17-843e-77fc2ba0dd4e', 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:30:55.104587 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.securitygroups_db [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Project 8cac4cebe6754e1a9f7a0dc1d0714835 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 11 14:30:55.111508 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:55.180472 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:55.221102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4312d4-a3f9-401d-9f40-3267124695c7 req-a8c14bd4-8ff5-49b6-8aad-3df594640c0e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:55.222684 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9c4312d4-a3f9-401d-9f40-3267124695c7 req-a8c14bd4-8ff5-49b6-8aad-3df594640c0e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0531664 Nov 11 14:30:55.227607 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:55.253241 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54eabe14-5949-411f-bcf7-1acdb926be1f,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:30:55.278404 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9c4312d4-a3f9-401d-9f40-3267124695c7 req-8c06dff1-14d9-4454-a167-8ba3c0a7477f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447381 Nov 11 14:30:55.312324 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:55.323209 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e779d7d8-98bd-45d5-bf33-9490ce4cd603 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3155992 Nov 11 14:30:56.262750 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 068b60f9-41f7-4bff-a739-8bc3dc2890c8 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:30:56.314739 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:30:56.315225 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:30:57.620742 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c675b9f-3f89-4ed1-b498-c17186779d94 req-e6b829c7-ef40-4e0a-81a8-bab33906c10c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:57.622318 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7c675b9f-3f89-4ed1-b498-c17186779d94 req-e6b829c7-ef40-4e0a-81a8-bab33906c10c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0530701 Nov 11 14:30:57.674193 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7c675b9f-3f89-4ed1-b498-c17186779d94 req-d6f03e64-14e1-4215-9652-3212bd3db5a9 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458252 Nov 11 14:30:58.026126 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38102) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:30:58.106805 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-e400ba7a-0c9c-43b5-8e2d-e5687db671a1 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0788105 Nov 11 14:30:58.115634 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-3ab2bf2e-04f8-4888-a2ce-910ee72632ce service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102268) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:30:58.116582 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-3ab2bf2e-04f8-4888-a2ce-910ee72632ce service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050230 Nov 11 14:30:58.795759 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ed1872-4592-4c6b-a5fb-5dc8ee1edfb2 req-3039ebe7-ec45-423c-881a-41ad39d25a6f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:58.797221 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-32ed1872-4592-4c6b-a5fb-5dc8ee1edfb2 req-3039ebe7-ec45-423c-881a-41ad39d25a6f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0505500 Nov 11 14:30:58.829995 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:30:58.845928 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-32ed1872-4592-4c6b-a5fb-5dc8ee1edfb2 req-2c89bfd3-a998-4f0b-a3f3-9f115fd4da92 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424812 Nov 11 14:30:59.971621 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc184edf-059b-4929-9d19-6ef9ffe7c039 req-2e892205-fe8b-43c1-9037-595ec9c1ad39 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:30:59.973171 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bc184edf-059b-4929-9d19-6ef9ffe7c039 req-2e892205-fe8b-43c1-9037-595ec9c1ad39 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0533626 Nov 11 14:31:00.020732 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bc184edf-059b-4929-9d19-6ef9ffe7c039 req-c3325570-5fd5-4f28-af50-751369880fe3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416045 Nov 11 14:31:00.617295 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-50f98366-b5ef-4097-b1c2-17b706bdbceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:00.618784 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-50f98366-b5ef-4097-b1c2-17b706bdbceb service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa&tenant_id=b69e80bc4d824db9a0104c514f7dc8fa HTTP/1.1" status: 200 len: 1096 time: 0.0411146 Nov 11 14:31:00.685174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-f4eb5a77-e73f-40af-bab7-4f027d993933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:00.686664 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-f4eb5a77-e73f-40af-bab7-4f027d993933 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1096 time: 0.0403104 Nov 11 14:31:00.787472 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-dbed65ad-6855-40ba-a131-92cd75633223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:00.789578 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-dbed65ad-6855-40ba-a131-92cd75633223 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0947227 Nov 11 14:31:00.855006 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-d1429e48-5d91-456f-abdc-b3e992efe5bc service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 998 time: 0.0588243 Nov 11 14:31:00.909263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-aa2dcfb7-a845-41c9-b9b7-1d60afaf2c16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:00.910713 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-aa2dcfb7-a845-41c9-b9b7-1d60afaf2c16 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0482924 Nov 11 14:31:00.959696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-747e6f83-c023-40b4-b695-294d63f8fa8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:00.961783 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-747e6f83-c023-40b4-b695-294d63f8fa8a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429361 Nov 11 14:31:01.052315 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-f14fdd23-7c01-4322-862d-e431f3187afe service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829682 Nov 11 14:31:01.149003 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc0a196-b42d-489c-a831-e0404357d329 req-c27a2644-edb1-49ba-8faf-181099dc024c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:01.150384 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f7592493-d6f9-48bc-8acd-32e0ec283f69 req-4548db84-08fb-439a-9f7b-3c26b1f25222 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909455 Nov 11 14:31:01.151145 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9dc0a196-b42d-489c-a831-e0404357d329 req-c27a2644-edb1-49ba-8faf-181099dc024c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0550733 Nov 11 14:31:01.202608 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9dc0a196-b42d-489c-a831-e0404357d329 req-3d6884d5-1fcd-417c-831f-8b0c86c5db80 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449896 Nov 11 14:31:02.329069 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40fa564b-27a3-463e-965f-f01e99595a81 req-2823d3f1-e894-46c3-8b41-afdf822eafdb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:02.330537 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-40fa564b-27a3-463e-965f-f01e99595a81 req-2823d3f1-e894-46c3-8b41-afdf822eafdb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0498276 Nov 11 14:31:02.394929 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-40fa564b-27a3-463e-965f-f01e99595a81 req-8e9a73d3-2729-44a4-ae8f-be336316e843 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569077 Nov 11 14:31:03.520917 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ac8e83-0102-4612-abb0-cd338a77cd4d req-5a6e37eb-fd06-41dc-8491-0cb92d99b2cf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:03.522407 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e4ac8e83-0102-4612-abb0-cd338a77cd4d req-5a6e37eb-fd06-41dc-8491-0cb92d99b2cf tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0518076 Nov 11 14:31:03.584548 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e4ac8e83-0102-4612-abb0-cd338a77cd4d req-ae8b5af1-3946-449d-97bb-d5f6598c4ef2 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508797 Nov 11 14:31:04.727587 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3cc64f-d917-495f-93d0-cb4fe32bf34e req-06b97348-6897-4afe-b5cf-6cafd47c32da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:04.729109 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd3cc64f-d917-495f-93d0-cb4fe32bf34e req-06b97348-6897-4afe-b5cf-6cafd47c32da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0569282 Nov 11 14:31:04.778439 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd3cc64f-d917-495f-93d0-cb4fe32bf34e req-e1693591-392f-4524-9c8c-dfd5bb5da8cb tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433612 Nov 11 14:31:05.762787 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-56c17b49-5deb-4e98-a18c-6c691a1cb50c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1062906159&fields=id&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 267 time: 0.0468771 Nov 11 14:31:05.882914 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-0d36a17b-60c8-4b67-9bf6-03b9b71859a0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:05.890462 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-0d36a17b-60c8-4b67-9bf6-03b9b71859a0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1206586 Nov 11 14:31:05.913195 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-732f3ab2-f626-4afc-93c7-402b54746b97 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/quotas/2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 375 time: 0.0217919 Nov 11 14:31:05.924120 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1048fced-0673-4610-a110-4ed654f7bb75 req-7c3adeca-e06a-4db9-a2a9-80fc711ded7e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:05.932643 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1048fced-0673-4610-a110-4ed654f7bb75 req-7c3adeca-e06a-4db9-a2a9-80fc711ded7e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0699501 Nov 11 14:31:05.981170 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-e65542ca-6a91-42e0-8308-066df5b75eb1 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0652938 Nov 11 14:31:05.991984 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1048fced-0673-4610-a110-4ed654f7bb75 req-f4ab1f4e-c9a3-4163-ba61-c957dca7c390 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583332 Nov 11 14:31:06.056929 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c318326b-1806-413e-a8bc-d2cab1d9ba1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:06.149285 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-68d5c538-6f39-46bd-a30f-c5593e3b2d8c service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1523163 Nov 11 14:31:06.241944 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-9c8fd1e8-3d93-4e3c-a0fa-169cbbc8110d service neutron] 10.222.0.10 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863988 Nov 11 14:31:06.824753 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-04bd079a-b11e-4c6c-ae3a-50e39f91be40 req-66a58119-e298-4118-a69f-b6961374fe5e tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0508118 Nov 11 14:31:07.146882 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd958255-35d1-454f-9abb-5a3155287cf9 req-e84872da-438e-455f-b0c9-e857cb62b092 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:07.156208 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bd958255-35d1-454f-9abb-5a3155287cf9 req-e84872da-438e-455f-b0c9-e857cb62b092 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0739040 Nov 11 14:31:07.217340 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bd958255-35d1-454f-9abb-5a3155287cf9 req-a00ec77d-92e3-4748-bdd9-057136604da3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601633 Nov 11 14:31:07.918538 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-58ba6774-47eb-4672-a4e4-8a4ecfee31f9 req-b86a44b5-d230-458a-a038-f99ba83f3af4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0259538 Nov 11 14:31:08.344069 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd2d0d3-fb5b-411b-8272-d384d5479969 req-bcc4791a-9c26-41c0-a352-0139caea8927 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:08.349139 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5dd2d0d3-fb5b-411b-8272-d384d5479969 req-bcc4791a-9c26-41c0-a352-0139caea8927 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0598652 Nov 11 14:31:08.397015 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5dd2d0d3-fb5b-411b-8272-d384d5479969 req-54db3853-5916-44af-9ca3-f45334f143de tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450878 Nov 11 14:31:08.475237 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-f3a719e8-7424-4222-a359-d763c06501dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:09.027830 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-413f9bbc-bf20-4730-9502-7448fbb119ba req-5a3706e9-6ba3-4bd0-a21b-9305431ce5bc tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0308924 Nov 11 14:31:09.522598 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3020d0-c60a-4c40-8d8b-88a98bc96aee req-487a9e86-dfed-4a8f-8e63-48f52e803639 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:09.524644 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bd3020d0-c60a-4c40-8d8b-88a98bc96aee req-487a9e86-dfed-4a8f-8e63-48f52e803639 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0502605 Nov 11 14:31:09.571265 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bd3020d0-c60a-4c40-8d8b-88a98bc96aee req-dfdd27d3-fac1-4a70-b111-781faf89514e tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407844 Nov 11 14:31:09.640057 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:10.139467 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-14911516-9aa7-4a36-9705-5f98044ad99a req-a396e671-46e0-4010-b98e-fb8020269ecc tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0263662 Nov 11 14:31:10.707187 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22ca5fa3-19dc-4d31-8a8f-32aa0eaf15b4 req-b20f9c92-0dbe-4d35-b61c-3241d2f4c9f1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:10.708724 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-22ca5fa3-19dc-4d31-8a8f-32aa0eaf15b4 req-b20f9c92-0dbe-4d35-b61c-3241d2f4c9f1 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0492804 Nov 11 14:31:10.749312 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:10.758972 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-22ca5fa3-19dc-4d31-8a8f-32aa0eaf15b4 req-a3ce6964-0bcd-4d13-ab94-2fb74aa50b42 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440707 Nov 11 14:31:11.231947 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bd4b4626-aea2-45c1-94f6-4f3525beec17 req-0b50d9e6-bcfc-4a01-ae66-5037d849c5c3 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0260231 Nov 11 14:31:11.738407 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:11.891357 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cedfe9c-4994-4748-a1c8-a0bf9ba70e5d req-84605c41-316f-4f33-854c-b339ed75d6d6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:11.894062 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6cedfe9c-4994-4748-a1c8-a0bf9ba70e5d req-84605c41-316f-4f33-854c-b339ed75d6d6 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0620768 Nov 11 14:31:11.949535 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6cedfe9c-4994-4748-a1c8-a0bf9ba70e5d req-062879ef-5d83-4e85-b8e7-037035fb4e5b tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487287 Nov 11 14:31:12.336695 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ea6c38c7-17d8-4ff9-9267-43156c7a9052 req-95715d9a-eadb-4de6-ae3a-36c13b5b07c8 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0261343 Nov 11 14:31:12.743719 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:13.075998 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc7ab03-6778-434e-a79b-3bb468cdfa01 req-bd2b352d-59c0-4ec0-af73-fad2e1f746bc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:13.077458 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0cc7ab03-6778-434e-a79b-3bb468cdfa01 req-bd2b352d-59c0-4ec0-af73-fad2e1f746bc tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0489464 Nov 11 14:31:13.124311 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0cc7ab03-6778-434e-a79b-3bb468cdfa01 req-c30b6c55-2d86-4e07-ac37-251b2f6a735f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410488 Nov 11 14:31:13.338778 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-d64d04ac-370a-4570-aa6d-4944dfaa2eca tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-101850944&fields=id&tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835 HTTP/1.1" status: 200 len: 267 time: 0.0471478 Nov 11 14:31:13.432188 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1561ee58-a272-4339-8b54-30dd4efb890d req-e44ebea4-8352-4f31-a0a8-657061c0b481 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0298007 Nov 11 14:31:13.448253 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-59bb6256-9b9f-415d-ba9f-0c67df30f0ed tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:13.449739 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-59bb6256-9b9f-415d-ba9f-0c67df30f0ed tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 807 time: 0.1042888 Nov 11 14:31:13.464593 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-24a71b70-27d9-48cd-9fed-03474fdc4bed tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/quotas/8cac4cebe6754e1a9f7a0dc1d0714835 HTTP/1.1" status: 200 len: 375 time: 0.0092020 Nov 11 14:31:13.514520 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-1f4cd51c-768f-4bd7-8e9e-f289f08333fb tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0447979 Nov 11 14:31:13.662333 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-2482b973-f698-4e6f-88a3-8349af7627b5 service neutron] 10.222.0.10 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1348782 Nov 11 14:31:13.749258 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-69a43891-2273-417d-ae17-36fd963be41d service neutron] 10.222.0.10 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809593 Nov 11 14:31:14.242485 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b402d7-540d-4344-bb05-0cf48e87b49b req-b3349855-1150-4bdc-97eb-566825265745 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:14.243944 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-33b402d7-540d-4344-bb05-0cf48e87b49b req-b3349855-1150-4bdc-97eb-566825265745 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0484114 Nov 11 14:31:14.293375 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-33b402d7-540d-4344-bb05-0cf48e87b49b req-332a0adb-e16c-42a8-89f2-16b317c62077 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434699 Nov 11 14:31:14.346470 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9b48fbeb-e8c4-49a5-a9d7-8fab92a5025f req-888e046b-d2ce-42f9-9700-4c0f650d5746 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0307937 Nov 11 14:31:14.526066 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-16e51155-24d7-4bb1-9e1d-2212ea85a363 req-36faba27-e335-41ab-9b9d-7d1ba8be9751 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0275865 Nov 11 14:31:14.567512 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-d49769d1-20d7-4256-861b-a0ea864c7c5b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:14.568948 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-d49769d1-20d7-4256-861b-a0ea864c7c5b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 811 time: 0.1003366 Nov 11 14:31:14.630493 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-78dacfe2-6cba-4f0d-9ee1-378e56132d0b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d09ad6536ff49c4b4e43c8239742bc5 HTTP/1.1" status: 200 len: 380 time: 0.0529435 Nov 11 14:31:14.639247 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'port': {'device_id': '83d39445-a054-4387-ae24-143171a79c3c', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'admin_state_up': True, 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'security_groups': ['2cfa354d-b685-49ff-add6-9fea82052f27']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:14.801315 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Made reservation on behalf of 2d09ad6536ff49c4b4e43c8239742bc5 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:31:14.808932 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:14.934315 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.20.0.5 (4bad907f-fd8e-4849-9ded-63b7501aff2a/2b677022-3ca7-40d0-ba96-f88e6df9c517/a0b2185b-e65b-4bed-940b-d8aa4cec73ef) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:31:15.068559 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:15.195881 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:15.239753 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:31:15.243347 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:31:15.245866 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:31:15.277556 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:15.294764 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.295325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.295946 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.296457 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.297004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.297549 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.298098 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.298671 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.299351 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.299923 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.300463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.301003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:15.327553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:15.328159 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:15.420321 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-85d17159-162b-4950-91bb-f1f2d4222bb2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7845640 Nov 11 14:31:15.435408 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Request body: {'port': {'device_id': '83d39445-a054-4387-ae24-143171a79c3c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:15.453000 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c0e9002b-f4a5-4031-ac8b-2ca57e932d95 req-31c283d8-766a-49a4-a98a-7ee39615d7cc tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0270524 Nov 11 14:31:15.473798 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbad9293-8f81-4aba-a781-73447c4a7ba9 req-007f7753-b4f7-471d-a405-9c50a64d519f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:15.475863 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fbad9293-8f81-4aba-a781-73447c4a7ba9 req-007f7753-b4f7-471d-a405-9c50a64d519f tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0912147 Nov 11 14:31:15.498608 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-67eff7ce-bd09-4563-a570-3771b7deb48a None None] Provisioning complete for port a0b2185b-e65b-4bed-940b-d8aa4cec73ef triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:31:15.503603 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-67eff7ce-bd09-4563-a570-3771b7deb48a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:15.520145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:15.533895 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-67eff7ce-bd09-4563-a570-3771b7deb48a None None] Port a0b2185b-e65b-4bed-940b-d8aa4cec73ef cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:31:15.649656 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1608ce5-df2c-4729-b8dc-4b0e903271b8 req-37d48102-e89c-464e-a319-df84618d972c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:15.651416 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a1608ce5-df2c-4729-b8dc-4b0e903271b8 req-37d48102-e89c-464e-a319-df84618d972c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 931 time: 0.0571253 Nov 11 14:31:15.706558 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a1608ce5-df2c-4729-b8dc-4b0e903271b8 req-e11a4639-c668-41a1-8d86-cdcc627cf347 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482631 Nov 11 14:31:15.818942 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fbad9293-8f81-4aba-a781-73447c4a7ba9 req-fd5e319a-6c66-482b-ae62-7ff3b569a879 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3368084 Nov 11 14:31:16.038411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0b2185b-e65b-4bed-940b-d8aa4cec73ef {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:31:16.045640 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.057258 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Transition to ACTIVE for port object a0b2185b-e65b-4bed-940b-d8aa4cec73ef will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:31:16.131308 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.180610 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Pushing event updated for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:16.255533 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Attempting to bind port a0b2185b-e65b-4bed-940b-d8aa4cec73ef on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:31:16.255870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Attempting to bind port a0b2185b-e65b-4bed-940b-d8aa4cec73ef by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:31:16.256206 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Attempting to bind port a0b2185b-e65b-4bed-940b-d8aa4cec73ef on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:31:16.261284 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Port a0b2185b-e65b-4bed-940b-d8aa4cec73ef on network 4bad907f-fd8e-4849-9ded-63b7501aff2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:31:16.261600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Attempting to bind port a0b2185b-e65b-4bed-940b-d8aa4cec73ef on network 4bad907f-fd8e-4849-9ded-63b7501aff2a {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:31:16.267411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 31, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:31:16.267619 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Checking segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:31:16.268002 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Bound using segment: {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:31:16.268423 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Bound port: a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'da028d45-e079-4155-9323-70c10aaac9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 329, 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:31:16.268777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.334277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:31:16.337270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:31:16.414480 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.507208 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.508642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.509903 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] 10.222.0.11 "PUT /v2.0/ports/a0b2185b-e65b-4bed-940b-d8aa4cec73ef HTTP/1.1" status: 200 len: 1093 time: 1.0804334 Nov 11 14:31:16.510366 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:16.512715 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3536adfe-48db-48bc-9fe2-71b682d7043f" -d '{"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:16.564455 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-73e4f46b-4218-474e-8488-a2e16c7fb7a0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.565948 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-73e4f46b-4218-474e-8488-a2e16c7fb7a0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 807 time: 0.1630380 Nov 11 14:31:16.570980 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98e842ea-ab9e-4f4a-aafe-a5c02b614b93 x-openstack-request-id: req-98e842ea-ab9e-4f4a-aafe-a5c02b614b93 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:16.571270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:16.571670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-98e842ea-ab9e-4f4a-aafe-a5c02b614b93 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:16.571930 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'status': 'completed', 'code': 200} Nov 11 14:31:16.593953 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79cac3b-14a7-4d17-baf2-6b19589b4401 service neutron] Pushing event updated for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:16.594448 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-511c7877-b1f2-4bf0-b4c1-3c64401d1e22 req-7a02547a-8b87-42fc-8a64-c93c59d9bd17 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0347219 Nov 11 14:31:16.678283 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-c4b98368-1956-46a4-a974-c4cd8b617ecd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.679906 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-c4b98368-1956-46a4-a974-c4cd8b617ecd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1096 time: 0.0857198 Nov 11 14:31:16.686390 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-c9908e3c-9a67-4b31-9706-dfe5fff7f396 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835 HTTP/1.1" status: 200 len: 379 time: 0.1024935 Nov 11 14:31:16.704980 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'port': {'device_id': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'admin_state_up': True, 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'security_groups': ['83058885-fc82-4d17-843e-77fc2ba0dd4e']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:16.787080 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:31:16.888827 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:16.901722 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'port_id': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'mac_address': 'fa:16:3e:88:4f:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 301, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:31:16.908774 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56becf2b-236b-4238-a9d8-ef6fbf6f3e4d req-d37bf703-f137-4ed6-a1b0-fa392d61e985 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.910294 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56becf2b-236b-4238-a9d8-ef6fbf6f3e4d req-d37bf703-f137-4ed6-a1b0-fa392d61e985 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.1083891 Nov 11 14:31:16.911287 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-117e204e-ece6-4f19-b015-654cb07ae641 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.912607 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-117e204e-ece6-4f19-b015-654cb07ae641 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2196386 Nov 11 14:31:16.946078 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:16.947208 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc01344-2070-4be1-b0ba-102d519a6f8d req-fe9f31b8-08a6-46af-9f2a-e2bfefe85077 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:16.948755 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fbc01344-2070-4be1-b0ba-102d519a6f8d req-fe9f31b8-08a6-46af-9f2a-e2bfefe85077 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 943 time: 0.0518212 Nov 11 14:31:16.964334 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:31:16.985375 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:17.004101 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fbc01344-2070-4be1-b0ba-102d519a6f8d req-47b48063-d896-4cdd-91bc-da6b9267610d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483754 Nov 11 14:31:17.046306 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56becf2b-236b-4238-a9d8-ef6fbf6f3e4d req-aa60e7b8-8838-448c-9b03-1e389e275c59 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0975220 Nov 11 14:31:17.064106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-aeef3f07-f49f-4e5c-97d8-8b247e0522c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:17.065603 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-3536adfe-48db-48bc-9fe2-71b682d7043f req-aeef3f07-f49f-4e5c-97d8-8b247e0522c3 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1437390 Nov 11 14:31:17.080460 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Made reservation on behalf of 8cac4cebe6754e1a9f7a0dc1d0714835 for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:31:17.080832 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:17.080974 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:17.131027 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=9']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:17.217160 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-24ff6129-25b0-42da-b203-72c5b14d42fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:17.218645 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-24ff6129-25b0-42da-b203-72c5b14d42fd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1096 time: 0.1129665 Nov 11 14:31:17.270708 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-e2ca31c3-ee2d-4ed3-be78-141d1bc4df6f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef HTTP/1.1" status: 200 len: 217 time: 0.0406835 Nov 11 14:31:17.274977 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Allocated IP 172.20.0.14 (423f335f-df68-4380-9f3a-d51e1811cc79/0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72/39852042-e8c3-45ba-9635-1bcf0760856e) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:31:17.317235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:31:17.351675 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-767f01d9-a7fc-422c-8ab5-954e25ec977d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:17.353694 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-767f01d9-a7fc-422c-8ab5-954e25ec977d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0745745 Nov 11 14:31:17.455064 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef204737-75df-4ffa-8af0-661089f012aa req-ff0664bf-2b80-4a4a-b7f6-796a6bf8c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:17.456593 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-ff0664bf-2b80-4a4a-b7f6-796a6bf8c7ba service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0950115 Nov 11 14:31:17.541553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:17.587843 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-ecc5b34c-7ced-4232-aa28-28b8f16d8cb2 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235816 Nov 11 14:31:17.665764 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:17.672655 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5638fb43-fe25-43ef-8f21-c70ec50d52eb req-e2c905c2-6163-4b88-ac4e-14525c520a94 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0308959 Nov 11 14:31:17.720728 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Network 423f335f-df68-4380-9f3a-d51e1811cc79 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:31:17.726177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:31:17.732965 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:31:17.736834 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ef204737-75df-4ffa-8af0-661089f012aa req-f1f8fa01-5722-4b72-8c85-885437e642dd service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410773 Nov 11 14:31:17.764750 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:17.790992 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:17.791694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:17.861009 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-f2dcdf5f-3a30-4182-b304-fe4bb04fbd29 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1667123 Nov 11 14:31:17.874830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Request body: {'port': {'device_id': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:17.933897 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.003267 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-d3f781f8-438b-447e-a940-ed4d3f4d1573 None None] Provisioning complete for port 39852042-e8c3-45ba-9635-1bcf0760856e triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:31:18.003837 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d3f781f8-438b-447e-a940-ed4d3f4d1573 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.036370 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-d3f781f8-438b-447e-a940-ed4d3f4d1573 None None] Port 39852042-e8c3-45ba-9635-1bcf0760856e cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:31:18.161659 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadf11a3-ef31-44e7-b053-1502155cef38 req-ac8297d7-caa9-4f7a-973b-2d8171b17ca5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.163209 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-eadf11a3-ef31-44e7-b053-1502155cef38 req-ac8297d7-caa9-4f7a-973b-2d8171b17ca5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0498962 Nov 11 14:31:18.173753 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a25dea-febe-4ee7-8fcf-82a3081a50aa req-b6ef02fd-1016-4064-9627-6977da02130c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.175236 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-24a25dea-febe-4ee7-8fcf-82a3081a50aa req-b6ef02fd-1016-4064-9627-6977da02130c tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 944 time: 0.0714777 Nov 11 14:31:18.215074 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-eadf11a3-ef31-44e7-b053-1502155cef38 req-83765548-3771-47f8-bde3-94d7b1083091 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454981 Nov 11 14:31:18.265906 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-24a25dea-febe-4ee7-8fcf-82a3081a50aa req-4c0fa815-814c-45f3-8389-b80041f4cc49 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843868 Nov 11 14:31:18.273681 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39852042-e8c3-45ba-9635-1bcf0760856e {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:31:18.281655 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.293365 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Transition to ACTIVE for port object 39852042-e8c3-45ba-9635-1bcf0760856e will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:31:18.360793 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.411765 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:18.480218 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Attempting to bind port 39852042-e8c3-45ba-9635-1bcf0760856e on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:31:18.480549 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Attempting to bind port 39852042-e8c3-45ba-9635-1bcf0760856e by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:31:18.480870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Attempting to bind port 39852042-e8c3-45ba-9635-1bcf0760856e on network 423f335f-df68-4380-9f3a-d51e1811cc79 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:31:18.485763 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Port 39852042-e8c3-45ba-9635-1bcf0760856e on network 423f335f-df68-4380-9f3a-d51e1811cc79 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:31:18.486081 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Attempting to bind port 39852042-e8c3-45ba-9635-1bcf0760856e on network 423f335f-df68-4380-9f3a-d51e1811cc79 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:31:18.491080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 31, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:31:18.491475 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Checking segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:31:18.491856 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Bound using segment: {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:31:18.492812 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Bound port: 39852042-e8c3-45ba-9635-1bcf0760856e, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb3037f5-86ce-4286-bbcf-8752577b0c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:31:18.493169 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.561256 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:31:18.564302 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:31:18.629640 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.663457 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.664277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.665996 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] 10.222.0.11 "PUT /v2.0/ports/39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 1094 time: 0.7954319 Nov 11 14:31:18.666429 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:18.668716 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12e6d640-7184-4de3-a6b6-00050dc6e357" -d '{"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:18.696403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc9e4288-4013-4ed2-b9e6-69e4fb92e53e service neutron] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:18.723582 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b107fc3-6112-43fa-b018-a6bf01e84b01 x-openstack-request-id: req-2b107fc3-6112-43fa-b018-a6bf01e84b01 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:18.723879 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:18.724182 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-2b107fc3-6112-43fa-b018-a6bf01e84b01 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:18.724532 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'status': 'completed', 'code': 200} Nov 11 14:31:18.787389 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:31:18.829548 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2e9a545-58fe-46ac-9966-8aa2c0a941d9 req-b8e0ea4e-87e4-491f-81c1-723307bdc408 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.831068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b2e9a545-58fe-46ac-9966-8aa2c0a941d9 req-b8e0ea4e-87e4-491f-81c1-723307bdc408 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0861466 Nov 11 14:31:18.833894 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-0fdf4148-8b5e-42d5-869a-9a6f8e817c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.835333 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-0fdf4148-8b5e-42d5-869a-9a6f8e817c58 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1097 time: 0.0883675 Nov 11 14:31:18.843070 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:31:18.843565 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.933333 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:18.941632 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b2e9a545-58fe-46ac-9966-8aa2c0a941d9 req-efa0bddc-ee1e-4dda-9ab8-cb0aa72d9ede tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1033819 Nov 11 14:31:18.955696 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:18.957912 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e549611-2578-42ba-9766-66c9088d80a6" -d '{"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:18.971545 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-fbeae674-defd-4f6a-ad29-8b69c41d21a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:18.973139 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-fbeae674-defd-4f6a-ad29-8b69c41d21a7 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&shared=False HTTP/1.1" status: 200 len: 908 time: 0.1217024 Nov 11 14:31:18.978504 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:18.995133 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-806ee5cb-221c-4480-945d-d22b654f25af x-openstack-request-id: req-806ee5cb-221c-4480-945d-d22b654f25af {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:18.995451 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-plugged", "status": "completed", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:18.997256 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-806ee5cb-221c-4480-945d-d22b654f25af {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:18.997256 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'code': 200} Nov 11 14:31:19.056869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:19.078669 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-469a155d-aa76-468d-9ae4-7afd184f5c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.080211 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12e6d640-7184-4de3-a6b6-00050dc6e357 req-469a155d-aa76-468d-9ae4-7afd184f5c28 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0982301 Nov 11 14:31:19.104357 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=10']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:19.167421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-1621a770-e9c9-4905-a749-76cac43778cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.168944 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-1621a770-e9c9-4905-a749-76cac43778cd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1097 time: 0.0413198 Nov 11 14:31:19.211561 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-6e22ced7-5a6b-4282-b518-c480c382c67e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 217 time: 0.0341909 Nov 11 14:31:19.268394 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-9488a66f-9f8d-42ed-bdae-2f0c0bb1c340 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.269864 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-9488a66f-9f8d-42ed-bdae-2f0c0bb1c340 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0508413 Nov 11 14:31:19.382875 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87b49f9-d7d4-4397-9a34-73e007d7a476 req-820e1c37-18ee-4ae1-91eb-544d76571637 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.386305 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e87b49f9-d7d4-4397-9a34-73e007d7a476 req-820e1c37-18ee-4ae1-91eb-544d76571637 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1099 time: 0.1063194 Nov 11 14:31:19.388034 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5736b151-06cd-439d-85bd-5396ba021420 req-b5b4f37f-a631-471d-b2e0-a69692c9ae11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.389365 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-b5b4f37f-a631-471d-b2e0-a69692c9ae11 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1088145 Nov 11 14:31:19.394166 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219d7e3a-a202-4d7d-b56c-b3605673351c req-588a3cc6-c51b-4703-a115-095b64470f59 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.395702 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-219d7e3a-a202-4d7d-b56c-b3605673351c req-588a3cc6-c51b-4703-a115-095b64470f59 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0560935 Nov 11 14:31:19.401677 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abde8036-fbb2-4189-aeb5-c3bbc6294185 req-1d60f321-d275-46b6-a823-e688d3d12621 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:19.403088 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-abde8036-fbb2-4189-aeb5-c3bbc6294185 req-1d60f321-d275-46b6-a823-e688d3d12621 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.1083424 Nov 11 14:31:19.444929 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-219d7e3a-a202-4d7d-b56c-b3605673351c req-4c6a9038-a7da-4e23-9c45-f30dbb89ae6a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423970 Nov 11 14:31:19.527176 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e87b49f9-d7d4-4397-9a34-73e007d7a476 req-bd88583c-d3ae-4f3a-85c9-65f5db6960db service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1220181 Nov 11 14:31:19.538463 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-abde8036-fbb2-4189-aeb5-c3bbc6294185 req-3d59991a-c817-4c5d-ae18-1b000a77db8a tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1211777 Nov 11 14:31:19.552976 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-80e4c892-7a86-4503-9232-b5ca0963aae4 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1489441 Nov 11 14:31:19.821785 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5736b151-06cd-439d-85bd-5396ba021420 req-b5d85729-3748-48d8-a4be-e014b96be4fd service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860589 Nov 11 14:31:20.068226 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1469c505-7c0e-44c7-9b74-e99535a9b785 req-4fa5c7e4-39bc-4d3f-9bc2-02d66dcb4925 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:20.069695 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1469c505-7c0e-44c7-9b74-e99535a9b785 req-4fa5c7e4-39bc-4d3f-9bc2-02d66dcb4925 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0557277 Nov 11 14:31:20.119574 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1469c505-7c0e-44c7-9b74-e99535a9b785 req-ce4eb446-ef4f-47a2-bfc5-585b9b12e03d tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426228 Nov 11 14:31:20.565679 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440044d9-3717-4b9f-833d-16236fc7ad25 req-0cb6dd74-2583-4a86-b536-e3cce9ab877d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:20.567175 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-440044d9-3717-4b9f-833d-16236fc7ad25 req-0cb6dd74-2583-4a86-b536-e3cce9ab877d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0486195 Nov 11 14:31:20.615388 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-440044d9-3717-4b9f-833d-16236fc7ad25 req-0b64aa18-3a6d-4dd7-baee-655066c2d298 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402162 Nov 11 14:31:20.651747 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-224099e6-f76e-4690-ad9f-09672e08cab5 req-15b61ff2-85ba-4f06-ae9d-6c69d7a01ac7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:20.653235 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-224099e6-f76e-4690-ad9f-09672e08cab5 req-15b61ff2-85ba-4f06-ae9d-6c69d7a01ac7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0490317 Nov 11 14:31:20.702600 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-224099e6-f76e-4690-ad9f-09672e08cab5 req-25181af6-f62b-4882-a2f9-5b74f6bc700c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434451 Nov 11 14:31:21.236950 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186353fb-8f1c-45d0-8178-8c64db2bced4 req-e5a7b7f3-e3ec-4146-bf40-ad50cd65c281 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:21.238343 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-186353fb-8f1c-45d0-8178-8c64db2bced4 req-e5a7b7f3-e3ec-4146-bf40-ad50cd65c281 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0512357 Nov 11 14:31:21.287342 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-186353fb-8f1c-45d0-8178-8c64db2bced4 req-b833078b-b7e9-473f-8a9c-4cdba2a127f5 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431376 Nov 11 14:31:21.731524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fe706a-fa53-463e-a1c9-53e5d7be7e42 req-056cc521-9ef9-4b57-8fb8-d714dd51fca3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:21.738569 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7fe706a-fa53-463e-a1c9-53e5d7be7e42 req-056cc521-9ef9-4b57-8fb8-d714dd51fca3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0538239 Nov 11 14:31:21.785690 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c7fe706a-fa53-463e-a1c9-53e5d7be7e42 req-c654354c-7fc9-4285-a58f-23ffa85c6be3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462618 Nov 11 14:31:21.818369 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b884dc-36c0-4123-b15e-709b07e02e38 req-42c06d7e-d65a-4b2f-9671-ea99491ff309 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:21.819845 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-69b884dc-36c0-4123-b15e-709b07e02e38 req-42c06d7e-d65a-4b2f-9671-ea99491ff309 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0487089 Nov 11 14:31:21.866935 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-69b884dc-36c0-4123-b15e-709b07e02e38 req-61017d36-a039-412e-82c7-368e09490f99 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411263 Nov 11 14:31:22.402278 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45cb3b3-9008-4663-98fa-4732779d7af3 req-0524d5af-f9a0-4cc2-ae75-9e521897c644 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:22.402278 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d45cb3b3-9008-4663-98fa-4732779d7af3 req-0524d5af-f9a0-4cc2-ae75-9e521897c644 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0506771 Nov 11 14:31:22.455095 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d45cb3b3-9008-4663-98fa-4732779d7af3 req-0094eb7b-e58e-408b-baa4-a14f6d71f580 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471518 Nov 11 14:31:22.913755 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517d6de0-5b27-4966-a800-3396c5e30cc4 req-c5a097c3-d5b3-4715-8815-ef1cea5bd529 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:22.916997 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-517d6de0-5b27-4966-a800-3396c5e30cc4 req-c5a097c3-d5b3-4715-8815-ef1cea5bd529 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0584292 Nov 11 14:31:22.963897 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-517d6de0-5b27-4966-a800-3396c5e30cc4 req-775260ea-b07d-4286-b1e7-8505d9d4d64d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410101 Nov 11 14:31:22.982635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e14ab5-e2d3-4549-8e83-15c10103b3a6 req-c2ef8b46-f43b-4ec0-95ec-e4c43fd6cc40 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:22.984136 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d0e14ab5-e2d3-4549-8e83-15c10103b3a6 req-c2ef8b46-f43b-4ec0-95ec-e4c43fd6cc40 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0484500 Nov 11 14:31:23.032101 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d0e14ab5-e2d3-4549-8e83-15c10103b3a6 req-6c7aa85d-539c-4e88-a357-1e34795977d9 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422912 Nov 11 14:31:23.566059 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6743c86f-a8b7-41f9-8543-b67fe65fc078 req-5d355652-67a3-4e47-ab9c-351e663b4de7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:23.567543 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6743c86f-a8b7-41f9-8543-b67fe65fc078 req-5d355652-67a3-4e47-ab9c-351e663b4de7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0481863 Nov 11 14:31:23.615201 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6743c86f-a8b7-41f9-8543-b67fe65fc078 req-d1d1db09-1f8c-4368-9852-5904d31b9b37 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412610 Nov 11 14:31:24.147524 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef44241-21cf-4ebb-a942-a96f1c2730bc req-de899863-1323-4c2c-a2f6-04f4cad89b8c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:24.148996 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fef44241-21cf-4ebb-a942-a96f1c2730bc req-de899863-1323-4c2c-a2f6-04f4cad89b8c tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0524044 Nov 11 14:31:24.197167 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fef44241-21cf-4ebb-a942-a96f1c2730bc req-904aa1ed-2209-4568-9456-1474b07dc7c5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424442 Nov 11 14:31:24.728052 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8811bac1-2272-4e4e-b558-95d0153d6b02 req-72eda59b-caff-48c3-95fb-c7e477064156 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:24.729507 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8811bac1-2272-4e4e-b558-95d0153d6b02 req-72eda59b-caff-48c3-95fb-c7e477064156 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0477717 Nov 11 14:31:24.790089 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8811bac1-2272-4e4e-b558-95d0153d6b02 req-77df04ff-402f-4a82-bd71-66776591998b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542190 Nov 11 14:31:25.307480 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc83d4e5-9acd-4614-bb86-d29233e948f8 req-a18a2bc4-5144-4629-b95c-84d224eb5f38 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:25.308916 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cc83d4e5-9acd-4614-bb86-d29233e948f8 req-a18a2bc4-5144-4629-b95c-84d224eb5f38 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0476482 Nov 11 14:31:25.356113 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cc83d4e5-9acd-4614-bb86-d29233e948f8 req-a67760ba-c724-4502-ae75-a81fd25b7b74 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415483 Nov 11 14:31:25.901276 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef3ea23-4ecb-4f09-8fcc-42426893cafd req-1eb332a0-58f4-4712-8f94-ffc5f18012fe tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:25.902741 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bef3ea23-4ecb-4f09-8fcc-42426893cafd req-1eb332a0-58f4-4712-8f94-ffc5f18012fe tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0490322 Nov 11 14:31:25.951178 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-bef3ea23-4ecb-4f09-8fcc-42426893cafd req-09037724-552c-43c6-9ca3-ed8530978d37 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425320 Nov 11 14:31:26.349211 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:31:26.475701 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4fce4b-5c0c-4638-bdb6-69893df65a54 req-be166ed8-c0ec-4ce4-a221-e51a18922c15 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:26.477679 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bc4fce4b-5c0c-4638-bdb6-69893df65a54 req-be166ed8-c0ec-4ce4-a221-e51a18922c15 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 943 time: 0.0566554 Nov 11 14:31:26.525296 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bc4fce4b-5c0c-4638-bdb6-69893df65a54 req-21cda780-cf94-4251-ae7f-0e5db36fdb84 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417395 Nov 11 14:31:26.788186 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0b2185b-e65b-4bed-940b-d8aa4cec73ef details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:31:27.001734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:27.012385 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'port_id': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'mac_address': 'fa:16:3e:db:81:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:31:27.052951 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:27.062754 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c168b68-fda1-4c5a-a158-2fc67fe057de req-0928718c-94cf-4fee-aec8-c1fb6850e087 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:27.064304 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1c168b68-fda1-4c5a-a158-2fc67fe057de req-0928718c-94cf-4fee-aec8-c1fb6850e087 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0482829 Nov 11 14:31:27.065471 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0b2185b-e65b-4bed-940b-d8aa4cec73ef {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:31:27.084745 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:27.113035 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1c168b68-fda1-4c5a-a158-2fc67fe057de req-218342cc-51a1-449a-bb20-f514004621f2 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426986 Nov 11 14:31:27.149742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:27.194450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:27.362067 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['a0b2185b-e65b-4bed-940b-d8aa4cec73ef'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:31:27.638789 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a999fd06-b6fc-486a-bc0b-3dc1ce8f3a13 req-b4f82e00-6e4b-40e0-9648-4001e66a8da0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:27.640160 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a999fd06-b6fc-486a-bc0b-3dc1ce8f3a13 req-b4f82e00-6e4b-40e0-9648-4001e66a8da0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 944 time: 0.0473948 Nov 11 14:31:27.687260 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a999fd06-b6fc-486a-bc0b-3dc1ce8f3a13 req-d8e56d28-2e1f-4e1c-bfe4-58d48c1788fa tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411155 Nov 11 14:31:28.229091 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c432125-c870-4395-922d-4d345abdf384 req-796d888b-c31e-47ef-9296-d48c80c43a46 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:28.233394 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c432125-c870-4395-922d-4d345abdf384 req-796d888b-c31e-47ef-9296-d48c80c43a46 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0518694 Nov 11 14:31:28.278149 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6c432125-c870-4395-922d-4d345abdf384 req-0f88a6cf-7a6d-4edb-a7ef-a5d6d02868a3 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416982 Nov 11 14:31:28.795852 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:31:28.798042 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0b2185b-e65b-4bed-940b-d8aa4cec73ef up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:31:28.799920 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3a13ac-3a71-43a6-b359-569dea733808 req-1481a235-59c1-45ed-a178-406544f10d62 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:28.801390 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2c3a13ac-3a71-43a6-b359-569dea733808 req-1481a235-59c1-45ed-a178-406544f10d62 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 944 time: 0.0502429 Nov 11 14:31:28.855559 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2c3a13ac-3a71-43a6-b359-569dea733808 req-167f09dc-0612-40fa-8287-e2b72e63707f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480509 Nov 11 14:31:28.928168 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:28.939426 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '39852042-e8c3-45ba-9635-1bcf0760856e', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'mac_address': 'fa:16:3e:87:8f:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 309, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:31:28.966797 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port a0b2185b-e65b-4bed-940b-d8aa4cec73ef completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:31:28.976231 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port a0b2185b-e65b-4bed-940b-d8aa4cec73ef triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:31:28.976603 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:28.995783 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:29.019556 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39852042-e8c3-45ba-9635-1bcf0760856e {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:31:29.044771 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:29.081303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:29.102381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:29.104600 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9cfc91a2-eb54-483b-8588-c576590a7c86" -d '{"events": [{"server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "name": "network-vif-plugged", "status": "completed", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:29.114124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:29.124879 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:29.145255 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee3f9953-8ddf-4f5a-b4ab-5a0fd711095e x-openstack-request-id: req-ee3f9953-8ddf-4f5a-b4ab-5a0fd711095e {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:29.145545 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "name": "network-vif-plugged", "status": "completed", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:29.145794 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-ee3f9953-8ddf-4f5a-b4ab-5a0fd711095e {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:29.146172 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'code': 200} Nov 11 14:31:29.174002 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:29.200644 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:29.249707 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:29.347326 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['39852042-e8c3-45ba-9635-1bcf0760856e'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:31:29.390991 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc57dfd-d737-4d7f-8079-fddb0c8d36de req-366b84cf-af7c-4e2b-be27-b5a6cd403dc0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:29.392853 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bbc57dfd-d737-4d7f-8079-fddb0c8d36de req-366b84cf-af7c-4e2b-be27-b5a6cd403dc0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 945 time: 0.0496349 Nov 11 14:31:29.448235 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bbc57dfd-d737-4d7f-8079-fddb0c8d36de req-ba144f80-b299-4cd1-ab8c-2d7cc9ffa743 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489166 Nov 11 14:31:29.502406 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e7177c-cc83-40c7-a4a9-f1d0796a2c39 req-3a81c831-57bf-49dd-8648-72cc3b71eaf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:29.503865 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d7e7177c-cc83-40c7-a4a9-f1d0796a2c39 req-3a81c831-57bf-49dd-8648-72cc3b71eaf0 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1098 time: 0.0431924 Nov 11 14:31:29.549620 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d7e7177c-cc83-40c7-a4a9-f1d0796a2c39 req-4aba1831-5e99-48de-b804-82ec27950a7a service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388801 Nov 11 14:31:29.970105 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff734295-f296-4793-806b-317adc31d209 req-366d8fcc-2c6f-4c3c-9113-ac62901437c4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:29.971574 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ff734295-f296-4793-806b-317adc31d209 req-366d8fcc-2c6f-4c3c-9113-ac62901437c4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0470555 Nov 11 14:31:30.022925 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ff734295-f296-4793-806b-317adc31d209 req-e5e0aa1e-f440-4bf2-9727-d012b9fbdf6b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449376 Nov 11 14:31:30.566102 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add32f40-2b38-481b-a8c4-46637162ca91 req-88112fd9-d289-4caa-ad91-cd23b1407c87 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:30.567689 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-add32f40-2b38-481b-a8c4-46637162ca91 req-88112fd9-d289-4caa-ad91-cd23b1407c87 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 945 time: 0.0509634 Nov 11 14:31:30.616600 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-add32f40-2b38-481b-a8c4-46637162ca91 req-bb08cc32-a7c8-41a9-80b0-ef02b8a7a713 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424984 Nov 11 14:31:30.803535 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:31:30.903025 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 39852042-e8c3-45ba-9635-1bcf0760856e completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:31:30.906788 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 39852042-e8c3-45ba-9635-1bcf0760856e triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:31:30.907153 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:30.983016 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:31.018205 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:31.074886 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:31.122192 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:31.140076 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b86b1c-3afd-4cfe-a462-9f8a6880f613 req-ecd685db-605e-413d-bf5b-e3323986b1d2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:31.141792 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-93b86b1c-3afd-4cfe-a462-9f8a6880f613 req-ecd685db-605e-413d-bf5b-e3323986b1d2 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0505462 Nov 11 14:31:31.147603 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:31.150444 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9da16463-cf59-482a-b101-d318895bfaa4" -d '{"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-plugged", "status": "completed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:31.184880 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea6c6665-22e2-4e1b-a6bd-e1eb70ad3822 x-openstack-request-id: req-ea6c6665-22e2-4e1b-a6bd-e1eb70ad3822 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:31.185176 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-plugged", "status": "completed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:31.185432 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-ea6c6665-22e2-4e1b-a6bd-e1eb70ad3822 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:31.185824 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'code': 200} Nov 11 14:31:31.190804 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-93b86b1c-3afd-4cfe-a462-9f8a6880f613 req-d688cd53-62d1-42a1-9e45-79bf1e957b09 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432560 Nov 11 14:31:31.308825 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934d1736-be44-476a-b4db-01e526d1b511 req-908dfea8-15cc-4393-8507-cd039394c77d tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:31.310192 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-934d1736-be44-476a-b4db-01e526d1b511 req-908dfea8-15cc-4393-8507-cd039394c77d tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0534692 Nov 11 14:31:31.359628 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-934d1736-be44-476a-b4db-01e526d1b511 req-7d5c090e-5f54-482c-a875-3dd20cfe4673 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435891 Nov 11 14:31:31.381266 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38412) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:31:31.516485 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e7881fd-0a73-42b8-a5ca-da9f8869a00c tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:31.519107 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2e7881fd-0a73-42b8-a5ca-da9f8869a00c tempest-TestVolumeBootPattern-921340765 tempest-TestVolumeBootPattern-921340765-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1093 time: 0.1357620 Nov 11 14:31:31.520762 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38416) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:31:31.525575 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'port_id': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:31.595205 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:31.596804 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e14d1a5-7de0-419a-a9d0-6a35797574e9 req-f9e736d5-bb5c-4fc0-9074-d21e20f812a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:31.598246 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e14d1a5-7de0-419a-a9d0-6a35797574e9 req-f9e736d5-bb5c-4fc0-9074-d21e20f812a6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.0388277 Nov 11 14:31:31.647761 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2e14d1a5-7de0-419a-a9d0-6a35797574e9 req-47af4ebf-07da-4f6a-884b-9a72379e0936 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384574 Nov 11 14:31:31.695571 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:31.736799 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742560c6-8310-43bc-883c-622931da7057 req-e07df7b3-7144-48f5-855e-08a3bc636c27 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:31.738380 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-742560c6-8310-43bc-883c-622931da7057 req-e07df7b3-7144-48f5-855e-08a3bc636c27 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0522840 Nov 11 14:31:31.787174 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-742560c6-8310-43bc-883c-622931da7057 req-62a0754e-7f9a-4086-866e-b2c5bb26ca5e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428190 Nov 11 14:31:31.803587 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Allocated IP 172.27.1.48 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/3408179d-404c-4cfb-a0ec-6bfd70f97f2d) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:31:31.905336 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:31.983801 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.021540 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:31:32.026289 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:31:32.029745 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:31:32.035652 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=3408179d-404c-4cfb-a0ec-6bfd70f97f2d,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:32.061146 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.061491 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.061828 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.062156 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.062480 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.062807 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.063128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.063474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.063797 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.064113 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.064432 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.064744 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:31:32.392232 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.520562 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.668285 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.726236 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.796052 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event updated for resources: {'Port': ['ID=3408179d-404c-4cfb-a0ec-6bfd70f97f2d,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:32.812749 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:32.946696 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e0958a-cebe-47ea-ae3e-feadd725a582 req-3ab6867d-84df-4e98-8f52-9e70a2c1e053 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:32.948224 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-10e0958a-cebe-47ea-ae3e-feadd725a582 req-3ab6867d-84df-4e98-8f52-9e70a2c1e053 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0942235 Nov 11 14:31:32.950999 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP 56470eac-d56e-4bc1-89a9-5065353243c7 associated. External IP: 172.27.1.48, port: a0b2185b-e65b-4bed-940b-d8aa4cec73ef. Nov 11 14:31:33.067572 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-10e0958a-cebe-47ea-ae3e-feadd725a582 req-5d84f07e-4801-42bb-b32b-fe0373386bbb tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1131070 Nov 11 14:31:33.190572 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:31:33.544169 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:31:33.555424 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:31:33.564183 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:33.564794 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:33.648542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:33.668694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:33.674823 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9b81c13f-1e98-4df8-8efc-2c9346006809 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1530809 Nov 11 14:31:33.675455 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:33.677638 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8e10f36-5477-4f01-bfdc-8a231ae1b043" -d '{"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:33.715986 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c953ab96-8d71-493a-9f34-f0a9158d2e01 x-openstack-request-id: req-c953ab96-8d71-493a-9f34-f0a9158d2e01 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:33.716267 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:33.716539 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-c953ab96-8d71-493a-9f34-f0a9158d2e01 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:33.716928 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'status': 'completed', 'code': 200} Nov 11 14:31:33.777421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-eac266e8-775f-4a3d-a3c9-926325f2585d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:33.778921 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-eac266e8-775f-4a3d-a3c9-926325f2585d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1098 time: 0.0398705 Nov 11 14:31:33.898911 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}, {'id': '56470eac-d56e-4bc1-89a9-5065353243c7', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.48', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:db:81:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83d39445-a054-4387-ae24-143171a79c3c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:32Z', 'updated_at': '2021-11-11T14:31:32Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:33.925901 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:31:33.935442 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:33.936053 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:34.041760 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:34.109650 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-dae12b79-0909-4985-8c4f-2cf0926e4c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.110349 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-dae12b79-0909-4985-8c4f-2cf0926e4c02 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.3176517 Nov 11 14:31:34.184813 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2c67ff-cc3b-4bf8-816a-ac01dd342865 req-0eb883f4-b3c3-4d0b-bec1-9d2bdf0e2129 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.186294 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ad2c67ff-cc3b-4bf8-816a-ac01dd342865 req-0eb883f4-b3c3-4d0b-bec1-9d2bdf0e2129 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0503933 Nov 11 14:31:34.188139 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-a47f344b-59e6-407c-ae5a-1b23a9600814 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef HTTP/1.1" status: 200 len: 998 time: 0.0622983 Nov 11 14:31:34.239789 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-699947bc-41ca-405c-9b62-70b4fbdae57c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.241238 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-699947bc-41ca-405c-9b62-70b4fbdae57c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0456116 Nov 11 14:31:34.247187 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-ad2c67ff-cc3b-4bf8-816a-ac01dd342865 req-6be78c9d-7cd8-43e4-8073-f86c2abdf8ad tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548708 Nov 11 14:31:34.274124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}, {'id': '56470eac-d56e-4bc1-89a9-5065353243c7', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.48', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:db:81:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83d39445-a054-4387-ae24-143171a79c3c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:32Z', 'updated_at': '2021-11-11T14:31:32Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:34.294976 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-b28a65aa-eeda-498c-8128-eb46b45781de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.296543 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-b28a65aa-eeda-498c-8128-eb46b45781de service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477161 Nov 11 14:31:34.305456 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b42ed4d2-7478-44be-be96-664402d24834 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}, {'id': '56470eac-d56e-4bc1-89a9-5065353243c7', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.48', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 620, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:db:81:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83d39445-a054-4387-ae24-143171a79c3c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:32Z', 'updated_at': '2021-11-11T14:31:32Z', 'revision_number': 0, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:31:34.426214 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc9654b-7ab7-4156-9081-b856a924e35b req-c3a60922-3a74-4b54-afcf-a88d4f90be6a tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.427723 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fbc9654b-7ab7-4156-9081-b856a924e35b req-c3a60922-3a74-4b54-afcf-a88d4f90be6a tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.1108758 Nov 11 14:31:34.435068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-15685b33-c19a-475a-9174-262593d3cd18 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304011 Nov 11 14:31:34.506853 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6451a7fe-9c2b-457b-ba27-ca98303cc810 None None] New status for floating IP 56470eac-d56e-4bc1-89a9-5065353243c7: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:31:34.535108 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fbc9654b-7ab7-4156-9081-b856a924e35b req-2609b3a9-dbac-48d7-8997-ff8aac4a5ee4 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0990746 Nov 11 14:31:34.560052 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38430) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:31:34.560905 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c8e10f36-5477-4f01-bfdc-8a231ae1b043 req-6312c3f6-7662-41fa-b725-b8d8cf103dd5 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1105037 Nov 11 14:31:34.642098 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e86df25c-4cf4-45a8-84dd-8bd5f2ba6298 tempest-TestShelveInstance-2142329761 tempest-TestShelveInstance-2142329761-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:34.643658 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e86df25c-4cf4-45a8-84dd-8bd5f2ba6298 tempest-TestShelveInstance-2142329761 tempest-TestShelveInstance-2142329761-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1094 time: 0.0825341 Nov 11 14:31:34.646562 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38434) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:31:34.651435 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:31:34.760139 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:34.858461 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:34.964080 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Allocated IP 172.27.1.235 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/fe0d99fd-86ac-441d-b07b-f5a9946f1290) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:31:35.064686 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.155047 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.192160 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:31:35.197339 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:31:35.200847 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:31:35.225790 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'Port': ['ID=fe0d99fd-86ac-441d-b07b-f5a9946f1290,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:35.564151 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.690699 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.847945 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.903726 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:35.974517 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event updated for resources: {'Port': ['ID=fe0d99fd-86ac-441d-b07b-f5a9946f1290,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:35.984914 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:36.016843 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2842233a-717e-4a57-8d7f-7e1ed3b346ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:36.089945 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Floating IP 24404322-f956-4643-8f7c-6e5be0ff82ad associated. External IP: 172.27.1.235, port: 39852042-e8c3-45ba-9635-1bcf0760856e. Nov 11 14:31:36.294204 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Router d633719b-30dc-4e87-97ff-8877f6c9e64b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:31:36.407571 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:31:36.413630 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Sync routers for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:31:36.423562 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:36.424169 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:36.522927 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:36.552142 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-332e9a45-ecf9-40bf-b99a-4f918cfeeb76 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9045539 Nov 11 14:31:36.552712 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:36.554999 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-308115aa-18fe-4c97-b1ac-2c5eef44385e" -d '{"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:36.604305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3d496cd-45e9-4f6e-9fd9-09a53f61bfa1 x-openstack-request-id: req-a3d496cd-45e9-4f6e-9fd9-09a53f61bfa1 {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:36.604305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:36.604305 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a3d496cd-45e9-4f6e-9fd9-09a53f61bfa1 {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:36.604305 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'status': 'completed', 'code': 200} Nov 11 14:31:36.651776 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:36.679034 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-041b6f75-1b11-4505-acf7-262f62351e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:36.680436 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-041b6f75-1b11-4505-acf7-262f62351e1c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.0441492 Nov 11 14:31:36.771754 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-eabe0a9c-7dbe-4173-832f-1299d580a72a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:36.773199 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-eabe0a9c-7dbe-4173-832f-1299d580a72a service neutron] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 908 time: 0.0861700 Nov 11 14:31:36.853613 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-2e6e40e1-c4f9-4f8a-86db-6780452f3a3b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 1000 time: 0.0642998 Nov 11 14:31:36.882011 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '24404322-f956-4643-8f7c-6e5be0ff82ad', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'floating_ip_address': '172.27.1.235', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 622, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'mac_address': 'fa:16:3e:87:8f:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:35Z', 'updated_at': '2021-11-11T14:31:35Z', 'revision_number': 0, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:36.908193 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-815480ab-4343-4276-a9af-d159572c2cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:36.909778 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-815480ab-4343-4276-a9af-d159572c2cf6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0491343 Nov 11 14:31:36.913274 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Checking router: d633719b-30dc-4e87-97ff-8877f6c9e64b for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:31:36.921596 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:36.922177 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:36.958041 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-23007951-7da9-4c08-ba7c-c821a82a28e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:36.959592 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-23007951-7da9-4c08-ba7c-c821a82a28e4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418587 Nov 11 14:31:37.026903 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:37.065064 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-0f97a9dc-0268-4ddf-80d1-c857b73dddb1 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888872 Nov 11 14:31:37.160909 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-308115aa-18fe-4c97-b1ac-2c5eef44385e req-adc279ba-0682-4000-b6d5-74da3c45b3ff service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882318 Nov 11 14:31:37.251232 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '24404322-f956-4643-8f7c-6e5be0ff82ad', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'floating_ip_address': '172.27.1.235', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 622, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'mac_address': 'fa:16:3e:87:8f:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:35Z', 'updated_at': '2021-11-11T14:31:35Z', 'revision_number': 0, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:37.278039 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47dab041-5a18-4030-b150-db19e066aea9 None None] The sync data for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi is: [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '24404322-f956-4643-8f7c-6e5be0ff82ad', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'floating_ip_address': '172.27.1.235', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 622, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'mac_address': 'fa:16:3e:87:8f:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:31:35Z', 'updated_at': '2021-11-11T14:31:35Z', 'revision_number': 0, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:31:37.455691 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7ea4b90-240b-4e84-b1d0-0a7b7b57efca None None] New status for floating IP 24404322-f956-4643-8f7c-6e5be0ff82ad: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:31:38.492019 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a6598237-719b-490d-94f3-e64738d45b28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:39.640242 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:40.770816 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:41.685957 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:42.124982 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:45.900598 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-7feca81b-a8d8-48b6-aa42-14118aa001ea service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401504 Nov 11 14:31:45.990145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-733be40d-a0d1-4dba-998c-4c3e2f48a3bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:45.991640 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-733be40d-a0d1-4dba-998c-4c3e2f48a3bd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 1099 time: 0.0431724 Nov 11 14:31:46.097163 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-ff20ee7e-1788-4c07-af6e-a0458b8f0103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:46.098608 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-ff20ee7e-1788-4c07-af6e-a0458b8f0103 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 200 len: 918 time: 0.0836239 Nov 11 14:31:46.172288 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-6a73b72d-8f07-4ac2-9da3-12d5922a8560 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 200 len: 1000 time: 0.0616932 Nov 11 14:31:46.223152 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-f49f68af-7c6f-4775-977b-44a6c78eef36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:46.224601 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-f49f68af-7c6f-4775-977b-44a6c78eef36 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 200 len: 856 time: 0.0443759 Nov 11 14:31:46.281546 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-2f9237c7-a826-447c-bc53-c451cf8b0f68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:46.283060 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-2f9237c7-a826-447c-bc53-c451cf8b0f68 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c68a47ca-25f9-4130-912b-bec65a17b2f1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401373 Nov 11 14:31:46.379675 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-558e9d43-36ea-48f8-9734-03f6588a1966 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847771 Nov 11 14:31:46.480522 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56f8d1f0-58c5-4c8d-84e1-2b1e6bace3c8 req-f9b22f1c-6798-43fa-bf6e-24df78532f15 service neutron] 10.222.0.11 "GET /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800118 Nov 11 14:31:56.844168 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2384600-65c2-49d7-be42-ec40ca9442f3 req-8233aacf-8cdc-484b-a234-5e543b0e68da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:56.845616 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d2384600-65c2-49d7-be42-ec40ca9442f3 req-8233aacf-8cdc-484b-a234-5e543b0e68da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0525277 Nov 11 14:31:56.892848 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d2384600-65c2-49d7-be42-ec40ca9442f3 req-3acb019c-6275-4581-ab4f-f2e578d262d3 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408061 Nov 11 14:31:58.013535 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3b90d1-4573-466b-9654-6246c6a98d2d req-13231ac8-c49b-4fda-90fe-a46e3f0a6349 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:58.015001 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f3b90d1-4573-466b-9654-6246c6a98d2d req-13231ac8-c49b-4fda-90fe-a46e3f0a6349 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0495191 Nov 11 14:31:58.062134 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3f3b90d1-4573-466b-9654-6246c6a98d2d req-7227b640-d8c3-44fd-abe5-673e366cec39 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups?id=15693065-525e-45e8-892f-4923e0104538&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409324 Nov 11 14:31:58.395838 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-193dc9d6-aed2-40b3-b764-67b5f3e29914 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:31:58.397382 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-193dc9d6-aed2-40b3-b764-67b5f3e29914 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 946 time: 0.0481887 Nov 11 14:31:58.491306 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Deleting port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:31:58.491592 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:58.577115 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] For port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:31:58.577470 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:58.789838 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:58.790103 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:58.790416 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Floating IP 97daf15f-148a-4c31-828b-edd84a0fc1c8 disassociated. External IP: 172.27.1.86, port: 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b. Nov 11 14:31:58.790748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Calling delete_port for 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:31:58.983054 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:59.011699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'Port': ['ID=4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:31:59.124525 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:31:59.192640 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4885d439-635f-4893-9ff5-6658758fac7c req-b030f8d9-cf08-417e-b339-9f09fc203a6a tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/ports?device_id=4ca1479b-a9f5-42d8-81f2-1325ccf9dffa HTTP/1.1" status: 200 len: 210 time: 0.0587335 Nov 11 14:31:59.251958 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:31:59.261919 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:31:59.271988 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:59.272600 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:59.292400 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] No DVR routers for this DVR port 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:31:59.294818 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:31:59.298181 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1a28f483-c856-46bc-8ddb-2d368a7b5248 req-4d3f542f-cbcf-4cda-9116-e3e74e80a454 tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.11 "DELETE /v2.0/ports/4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b HTTP/1.1" status: 204 len: 173 time: 0.8933265 Nov 11 14:31:59.298622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-deleted', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:31:59.301447 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33a7eb20-288c-492b-bfe6-70ebb88c7830" -d '{"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-deleted", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:31:59.338413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:31:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4390b74-6526-4fb0-9f5f-cc9a7da517b3 x-openstack-request-id: req-a4390b74-6526-4fb0-9f5f-cc9a7da517b3 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:31:59.338704 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ca1479b-a9f5-42d8-81f2-1325ccf9dffa", "name": "network-vif-deleted", "tag": "4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:31:59.338957 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a4390b74-6526-4fb0-9f5f-cc9a7da517b3 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:31:59.339358 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ca1479b-a9f5-42d8-81f2-1325ccf9dffa', 'name': 'network-vif-deleted', 'tag': '4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b', 'status': 'completed', 'code': 200} Nov 11 14:31:59.382408 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:59.591087 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:59.620664 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:31:59.628920 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:31:59.629511 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:59.731882 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:31:59.934016 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:31:59.958141 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239cf4e4-a521-4be5-b00d-33d589efc054 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:25:06Z', 'revision_number': 4, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '249d24ce-1e75-4ac7-ae15-555417147593', 'name': '', 'network_id': 'c68a47ca-25f9-4130-912b-bec65a17b2f1', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'mac_address': 'fa:16:3e:91:e2:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_interface', 'standard_attr_id': 296, 'fixed_ips': [{'subnet_id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:04Z', 'updated_at': '2021-11-11T14:25:13Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'subnets': [{'id': 'a758aa63-a5a7-49f1-8370-ad64ffdcb95b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:32:00.174881 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c267efc4-de9f-4d1c-aa8b-dbd5f5edf805 None None] New status for floating IP 97daf15f-148a-4c31-828b-edd84a0fc1c8: DOWN {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:32:00.348428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38482) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:00.403458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.426607 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.525526 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.528117 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.529242 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "DELETE /v2.0/security-groups/15693065-525e-45e8-892f-4923e0104538 HTTP/1.1" status: 204 len: 168 time: 0.1798284 Nov 11 14:32:00.532056 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38484) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:00.538886 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2023d8b-1367-4a55-820d-0bb21e3614ac tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=15693065-525e-45e8-892f-4923e0104538,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:00.545987 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.api.v2.resource [None req-607b80db-0f2b-4198-8fce-eeeafcc128da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] show failed (client error): The resource could not be found. Nov 11 14:32:00.546993 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-607b80db-0f2b-4198-8fce-eeeafcc128da tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "GET /v2.0/security-groups/15693065-525e-45e8-892f-4923e0104538 HTTP/1.1" status: 404 len: 347 time: 0.0139558 Nov 11 14:32:00.549894 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38486) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:00.668857 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Deleting port 878612e3-22c7-4877-81bf-3281de2585fa {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:32:00.669183 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.740048 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.740360 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.751463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Calling delete_port for 878612e3-22c7-4877-81bf-3281de2585fa owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:32:00.919934 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:00.944070 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Pushing event deleted for resources: {'Port': ['ID=878612e3-22c7-4877-81bf-3281de2585fa,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:01.006041 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:01.008620 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:01.009746 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-cba1cfa9-cdaa-4389-a354-0fb5b5e1a77d tempest-AttachVolumeShelveTestJSON-1521725588 tempest-AttachVolumeShelveTestJSON-1521725588-project] 10.222.0.10 "DELETE /v2.0/floatingips/97daf15f-148a-4c31-828b-edd84a0fc1c8 HTTP/1.1" status: 204 len: 168 time: 0.4589560 Nov 11 14:32:02.975834 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:32:02.999131 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:32:03.005249 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 4f178b4c-a3cf-4c6d-b76d-5f4caf4cd12b not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:32:03.348214 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:32:03.636523 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38510) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:04.062829 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:04.526280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Deleting port 249d24ce-1e75-4ac7-ae15-555417147593 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:32:04.526619 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:04.605210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] For port 249d24ce-1e75-4ac7-ae15-555417147593, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=249d24ce-1e75-4ac7-ae15-555417147593,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:04.605562 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:04.617933 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Calling delete_port for 249d24ce-1e75-4ac7-ae15-555417147593 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:32:04.851298 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:04.876597 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Pushing event deleted for resources: {'Port': ['ID=249d24ce-1e75-4ac7-ae15-555417147593,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:05.037944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.245736 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Router e1d54a86-4f94-4dff-9795-2ecd9436c55e has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:32:05.346999 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:32:05.352830 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e21e8d6b-bd6e-4c03-88f3-5b46dac1806a admin admin] 10.222.0.10 "PUT /v2.0/routers/e1d54a86-4f94-4dff-9795-2ecd9436c55e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7152905 Nov 11 14:32:05.355409 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38514) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:05.358626 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Sync routers for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:32:05.368420 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:05.369074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:05.457220 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks [] for router, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.569026 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.610738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:05.682782 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Deleting port a2276ac6-774c-4412-884e-d46de32946e4 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:32:05.683111 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.764544 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] For port a2276ac6-774c-4412-884e-d46de32946e4, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=a2276ac6-774c-4412-884e-d46de32946e4,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:05.764833 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.777711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Calling delete_port for a2276ac6-774c-4412-884e-d46de32946e4 owned by network:router_gateway {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:32:05.783953 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9'}], 'enable_snat': True}, 'gw_port_id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:32:04Z', 'revision_number': 5, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port': {'id': 'a2276ac6-774c-4412-884e-d46de32946e4', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 274, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.9', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:00Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:05.814224 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Checking router: e1d54a86-4f94-4dff-9795-2ecd9436c55e for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:32:05.823091 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Routers {'e1d54a86-4f94-4dff-9795-2ecd9436c55e'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:05.823736 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:31:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:05.936637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] Set router e1d54a86-4f94-4dff-9795-2ecd9436c55e gateway port host: None {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:05.994785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:05.997461 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:32:05Z', 'revision_number': 6, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:06.021106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Pushing event deleted for resources: {'Port': ['ID=a2276ac6-774c-4412-884e-d46de32946e4,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:06.032456 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab9ce07-2ad2-4f69-9198-740f7d1e0712 None None] The sync data for ids ['e1d54a86-4f94-4dff-9795-2ecd9436c55e'] in dv-cinder-777031-9-iscsi is: [{'id': 'e1d54a86-4f94-4dff-9795-2ecd9436c55e', 'name': 'tempest-AttachVolumeShelveTestJSON-1301590609-router', 'tenant_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:59Z', 'updated_at': '2021-11-11T14:32:05Z', 'revision_number': 6, 'project_id': 'b69e80bc4d824db9a0104c514f7dc8fa', 'gw_port_host': None}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:32:06.080810 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.107246 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3f7d7128-9045-487c-9238-24b2e01cdb7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.186124 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.188212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.314180 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.314717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1d54a86-4f94-4dff-9795-2ecd9436c55e {{(pid=102267) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:32:06.319569 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.320710 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-8bef67ac-d85b-4f68-b06a-2062d5fcbf39 admin admin] 10.222.0.10 "DELETE /v2.0/routers/e1d54a86-4f94-4dff-9795-2ecd9436c55e HTTP/1.1" status: 204 len: 168 time: 0.9643815 Nov 11 14:32:06.325297 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38518) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:06.366421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Deleting subnet a758aa63-a5a7-49f1-8370-ad64ffdcb95b {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:32:06.369946 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.412862 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.496263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.606300 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.634553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a758aa63-a5a7-49f1-8370-ad64ffdcb95b,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:06.638133 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.641648 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7fd5589b-cb35-4a0a-862b-09bcabd347b1 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/a758aa63-a5a7-49f1-8370-ad64ffdcb95b HTTP/1.1" status: 204 len: 168 time: 0.3174911 Nov 11 14:32:06.644520 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38520) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:06.646323 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b3036d5-7230-451b-98a7-821a31a98926 None None] Network c68a47ca-25f9-4130-912b-bec65a17b2f1 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:32:06.712106 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.763655 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Deleting port ef3d283d-240b-4f68-915c-45e8a5de4416 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:32:06.764158 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.805314 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 249d24ce-1e75-4ac7-ae15-555417147593 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:32:06.829220 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] DHCP port deletion for c68a47ca-25f9-4130-912b-bec65a17b2f1 request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:32:06.832134 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 249d24ce-1e75-4ac7-ae15-555417147593 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:32:06.832477 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 249d24ce-1e75-4ac7-ae15-555417147593 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:32:06.837109 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] For port ef3d283d-240b-4f68-915c-45e8a5de4416, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ef3d283d-240b-4f68-915c-45e8a5de4416,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:06.837458 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.851530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Calling delete_port for ef3d283d-240b-4f68-915c-45e8a5de4416 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:32:06.880711 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Deleting port ef3d283d-240b-4f68-915c-45e8a5de4416 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:32:06.881011 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.961778 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] For port ef3d283d-240b-4f68-915c-45e8a5de4416, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ef3d283d-240b-4f68-915c-45e8a5de4416,segment=NetworkSegment(71ca5e77-82e8-4016-9192-b9657483c90f),segment_id=71ca5e77-82e8-4016-9192-b9657483c90f)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:06.962268 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:06.974930 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Calling delete_port for ef3d283d-240b-4f68-915c-45e8a5de4416 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:32:06.982948 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.008610 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Pushing event deleted for resources: {'Port': ['ID=ef3d283d-240b-4f68-915c-45e8a5de4416,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:07.012179 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] No DVR routers for this DVR port ef3d283d-240b-4f68-915c-45e8a5de4416 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:32:07.053860 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.079043 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Pushing event deleted for resources: {'Port': ['ID=ef3d283d-240b-4f68-915c-45e8a5de4416,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:07.084113 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] No DVR routers for this DVR port ef3d283d-240b-4f68-915c-45e8a5de4416 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:32:07.091072 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.091436 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.091779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.092115 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.092447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.096213 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.096213 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.096213 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.096213 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.097022 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.097495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.097495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.097495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63cbabbd-1591-4931-9535-0447913c7815 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:07.115242 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c68a47ca-25f9-4130-912b-bec65a17b2f1']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:07.126167 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71ca5e77-82e8-4016-9192-b9657483c90f') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:07.126270 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71ca5e77-82e8-4016-9192-b9657483c90f') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:07.139138 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.151852 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.158953 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Releasing vlan 301 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:32:07.159343 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:32:07.160972 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:32:07.295437 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.303165 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.306371 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] 10.222.0.10 "DELETE /v2.0/networks/c68a47ca-25f9-4130-912b-bec65a17b2f1 HTTP/1.1" status: 204 len: 168 time: 0.6608651 Nov 11 14:32:07.316036 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1709368-5a52-4852-9585-0b0843407262 admin admin] Pushing event deleted for resources: {'Network': ['ID=c68a47ca-25f9-4130-912b-bec65a17b2f1,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:07.632784 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38524) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:07.672236 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-2a9dbf47-89f1-4ba6-bad9-bb01668f1e4f admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=b69e80bc4d824db9a0104c514f7dc8fa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375881 Nov 11 14:32:07.673844 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38526) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:07.718727 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.739254 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.839720 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.842319 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:07.843463 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/775d6914-66ff-45f9-bfc6-5976ee5f6450 HTTP/1.1" status: 204 len: 168 time: 0.1687281 Nov 11 14:32:07.850893 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f173d2d5-a5fc-4ca1-bfc5-efdff62efc61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=775d6914-66ff-45f9-bfc6-5976ee5f6450,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:08.295881 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ef3d283d-240b-4f68-915c-45e8a5de4416 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:32:08.320002 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: ef3d283d-240b-4f68-915c-45e8a5de4416 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:32:08.320329 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ef3d283d-240b-4f68-915c-45e8a5de4416 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:32:08.320746 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device a2276ac6-774c-4412-884e-d46de32946e4 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:32:08.339031 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: a2276ac6-774c-4412-884e-d46de32946e4 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:32:08.356358 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device a2276ac6-774c-4412-884e-d46de32946e4 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:32:08.439172 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0c2ccb96-8b79-4bc9-b075-74ee6178c032 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:08.902704 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38548) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:08.998078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1137613373-network', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:09.096569 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Made reservation on behalf of 1dfdd8159d1f45c99f739dea5093090b for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:32:09.098733 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.107826 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.178688 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.239669 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.260040 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 319} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:32:09.273531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c47264f-d3c5-41b4-9847-bf2feeb222d4,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:09.278059 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.278397 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Added segment 67956f27-c765-49dd-8650-765667d8ca05 of type vlan for network c7053be2-46f8-424c-a8b5-3cba0c2fb790 Nov 11 14:32:09.315308 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.399623 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.400633 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:09.401231 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.460882 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] Pushing event updated for resources: {'Network': ['ID=c7053be2-46f8-424c-a8b5-3cba0c2fb790,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:09.470484 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:32:09.488336 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-9e31cc7f-68a4-4205-8034-182fb302b167 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5845628 Nov 11 14:32:09.491732 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38552) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:09.496463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Request body: {'subnet': {'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1137613373-subnet', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:09.594277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Made reservation on behalf of 1dfdd8159d1f45c99f739dea5093090b for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:32:09.596614 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.684672 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.844189 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:09.888914 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Pushing event updated for resources: {'Subnet': ['ID=b823154a-6f60-4185-ba89-f69641669a9e,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:09.907731 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Checking segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:32:09.908311 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Network hostable DHCP agents. Network: c7053be2-46f8-424c-a8b5-3cba0c2fb790, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:32:09.993911 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:32:10.062372 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, c7053be2-46f8-424c-a8b5-3cba0c2fb790) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:10.066228 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:10.066813 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.073009 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99ad6b47-8dcb-4861-b988-89ef923e5d90 None None] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:32:10.128361 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ba0cce3d-7e39-4c68-94a6-c868463253ce admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6355164 Nov 11 14:32:10.131509 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38554) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:10.135670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:10.211690 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-394405', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-41382'] for router, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.212767 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-394457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-393851', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3672050', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-41389'] for router, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.215873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpdd493cf6-adac-5d47-a7a5-505057593940-c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e'}]}} from dv-cinder-777031-9-iscsi. {{(pid=102269) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 11 14:32:10.216716 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.265364 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.345263 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.db_base_plugin_common [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Allocated IP 172.20.0.2 (c7053be2-46f8-424c-a8b5-3cba0c2fb790/b823154a-6f60-4185-ba89-f69641669a9e/eced97f4-5f54-4c65-aae6-d3366be42455) {{(pid=102269) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:32:10.452704 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.483783 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks [] for port, precommit_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.548554 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872'] for port, after_create {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.584660 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is already hosted by enough agents. {{(pid=102269) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:10.587465 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.scheduler.base_scheduler [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Resources bound (agent type, host, resource id): {{(pid=102269) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:10.593950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Received port after_create {{(pid=102269) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:32:10.603679 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Pushing event updated for resources: {'Port': ['ID=eced97f4-5f54-4c65-aae6-d3366be42455,revision_number=1']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:10.655680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Attempting to bind port eced97f4-5f54-4c65-aae6-d3366be42455 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:32:10.656039 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Attempting to bind port eced97f4-5f54-4c65-aae6-d3366be42455 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:32:10.656393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Attempting to bind port eced97f4-5f54-4c65-aae6-d3366be42455 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:32:10.661852 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 31, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:32:10.662224 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Checking segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:32:10.662608 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.662996 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Bound using segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:32:10.663473 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Bound port: eced97f4-5f54-4c65-aae6-d3366be42455, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:32:10.663846 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.707580 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.725952 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.733850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] For port eced97f4-5f54-4c65-aae6-d3366be42455, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:32:10.737083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] For port eced97f4-5f54-4c65-aae6-d3366be42455, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=eced97f4-5f54-4c65-aae6-d3366be42455,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:32:10.765864 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.806423 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:10.826790 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Allocated IP 172.27.1.22 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/96417568-9e93-4dc3-ada5-85dd4d6ea2f9) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:32:10.866971 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af1e8839-f2f1-40eb-8df9-f20a2dff61f7 None None] Pushing event updated for resources: {'Port': ['ID=eced97f4-5f54-4c65-aae6-d3366be42455,revision_number=2']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:10.932667 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.016561 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.058611 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:11.063901 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:11.066482 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:32:11.091478 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Pushing event updated for resources: {'Port': ['ID=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:11.653414 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.701416 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c580fbac-3b60-4d11-aec0-57043887c11b None None] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:32:11.725410 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.777333 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] Provisioning complete for port eced97f4-5f54-4c65-aae6-d3366be42455 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:11.777608 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.850402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-396842', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-393900'] for router, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.920937 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:11.955184 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] For port eced97f4-5f54-4c65-aae6-d3366be42455, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=eced97f4-5f54-4c65-aae6-d3366be42455,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:12.021121 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.050009 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 is scheduled to L3 agent b13e4b14-a574-4cac-aadd-205be1453193 with binding_index 1 {{(pid=102267) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 11 14:32:12.081296 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6399a76e-42eb-4f5e-b3ac-d283768df5f3 None None] Pushing event updated for resources: {'Port': ['ID=eced97f4-5f54-4c65-aae6-d3366be42455,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:12.140798 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.145325 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-afdc2e48-30e5-454d-aa35-c71d12a00fcc None None] Provisioning complete for port eced97f4-5f54-4c65-aae6-d3366be42455 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:12.145791 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-afdc2e48-30e5-454d-aa35-c71d12a00fcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.164566 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:32:12.174587 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:32:12.185047 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:12.188873 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:12.219394 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.221311 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-623e6100-4872-4668-81f0-b7c39a2dd173 admin admin] 10.222.0.10 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.0888782 Nov 11 14:32:12.224678 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38556) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:12.298716 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:12.335490 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device eced97f4-5f54-4c65-aae6-d3366be42455 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:32:12.384335 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port eced97f4-5f54-4c65-aae6-d3366be42455 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:12.384701 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.572337 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:11Z', 'revision_number': 3, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:12.597715 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:32:12.597978 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Updating router 036f804a-de67-4309-b1fe-776c98e1bbc4 port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 binding host dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:32:12.625158 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.655354 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.808713 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Allocated IP 172.20.0.1 (c7053be2-46f8-424c-a8b5-3cba0c2fb790/b823154a-6f60-4185-ba89-f69641669a9e/b8bbbd88-6455-4786-a740-e30545812074) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:32:12.873611 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks [] for port, precommit_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.914042 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.931553 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.986039 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Attempting to bind port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:32:12.986422 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Attempting to bind port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:32:12.986770 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Attempting to bind port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 on network 2695a271-995b-4caa-b664-bb0645c2bc02 {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:32:12.989499 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Pushing event updated for resources: {'Port': ['ID=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,revision_number=2']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:12.996724 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 32, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:32:12.997190 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Checking segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102270) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:32:12.997582 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:12.997957 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Bound using segment: {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'} {{(pid=102270) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:32:12.998402 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.managers [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Bound port: 96417568-9e93-4dc3-ada5-85dd4d6ea2f9, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf60016-3240-46fc-a3a3-4c5e7de68220', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}}] {{(pid=102270) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:32:12.998791 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.001836 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.002189 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.002567 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.002909 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.003302 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.003654 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.003974 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.004295 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.004624 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.005481 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.005792 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.006106 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102270) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:13.016989 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.055004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:13.058062 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] For port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102270) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:32:13.059867 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:13.061922 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.plugins.ml2.db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] For port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102270) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:32:13.063471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:32:13.069558 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Pushing event updated for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:13.106152 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-395131'] for router_interface, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.137559 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron_lib.callbacks.manager [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102270) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.195758 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:13.196447 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:13.233840 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c88912-f19f-468a-b52c-646187a60966 None None] Pushing event updated for resources: {'Port': ['ID=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,revision_number=3']} {{(pid=102270) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:13.261268 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-bf9c470d-bfd0-4871-bd78-9de91c14c1b6 None None] Provisioning complete for port b8bbbd88-6455-4786-a740-e30545812074 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:13.261856 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-bf9c470d-bfd0-4871-bd78-9de91c14c1b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.284216 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.295469 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-bf9c470d-bfd0-4871-bd78-9de91c14c1b6 None None] Port b8bbbd88-6455-4786-a740-e30545812074 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:32:13.308755 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:13.445694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.479157 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:11Z', 'revision_number': 3, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:13.491049 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.508860 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4c75a3d-ff3d-4741-a692-f85459018588 None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:11Z', 'revision_number': 3, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:32:13.564486 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3696489', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-395247'] for router_interface, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.567122 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Pushing event updated for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:13.657906 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:13.659307 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:13.803103 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:32:13.918020 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:32:13.920372 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-ea3af744-4f07-4d86-a6b0-daa8e6b7af55 None None] Provisioning complete for port b8bbbd88-6455-4786-a740-e30545812074 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:13.920742 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ea3af744-4f07-4d86-a6b0-daa8e6b7af55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:13.923552 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-208e4774-beca-4e41-b813-97d7645423fc admin admin] 10.222.0.10 "PUT /v2.0/routers/036f804a-de67-4309-b1fe-776c98e1bbc4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6974471 Nov 11 14:32:13.959286 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-ea3af744-4f07-4d86-a6b0-daa8e6b7af55 None None] Port b8bbbd88-6455-4786-a740-e30545812074 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:32:14.319338 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:32:14.337177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38570) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:14.341893 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group': {'name': 'tempest-securitygroup--148251393', 'description': 'tempest-description--1431106219'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:14.370813 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:14.371176 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.422607 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.445898 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.465495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] For port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:14.489918 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.554377 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.611622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.642833 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c180698-7398-4106-96b0-85ffd84015a7,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:14.710527 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.711877 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-eda0bbf8-f088-44bf-a366-5422be97ab8d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3736112 Nov 11 14:32:14.722479 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38572) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:14.722479 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group_rule': {'security_group_id': '3c180698-7398-4106-96b0-85ffd84015a7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:14.734754 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Pushing event updated for resources: {'Port': ['ID=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:14.809430 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.864569 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.929940 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:14.950127 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=496b1104-04e0-44af-b838-7eaab3d24eb9,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:14.978150 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:32:14.988149 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:14.988744 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:15.031030 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.032361 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4b1f5f2d-33c1-4934-8f58-5c52badddcc6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3164160 Nov 11 14:32:15.035577 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38574) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:15.040645 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group_rule': {'security_group_id': '3c180698-7398-4106-96b0-85ffd84015a7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:15.091351 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:15.125746 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.181550 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.249732 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.268994 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0bcdbcd9-4eea-4d27-ad6a-958af3285c7b,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:15.289934 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 2, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:15.320522 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:32:15.321182 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Updating router 036f804a-de67-4309-b1fe-776c98e1bbc4 port b8bbbd88-6455-4786-a740-e30545812074 binding host dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 11 14:32:15.338768 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.340160 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d198e7bc-d2ca-42d8-a967-a074247c6cea tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3029447 Nov 11 14:32:15.343347 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38576) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:15.347837 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:15.347992 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.428477 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.529140 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.605481 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks [] for port, precommit_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.641357 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Allocated IP 172.27.1.55 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/298c6a9e-8b70-4658-a027-294e132f8325) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:32:15.714209 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.741337 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.793314 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a8d53c-d053-4394-8d30-266caba1b714 None None] Pushing event updated for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=3']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:15.823312 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.823579 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Attempting to bind port b8bbbd88-6455-4786-a740-e30545812074 on host dv-cinder-777031-9-iscsi for vnic_type normal with profile {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:32:15.824111 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Attempting to bind port b8bbbd88-6455-4786-a740-e30545812074 by drivers openvswitch,hyperv on host dv-cinder-777031-9-iscsi at level 0 using segments [{'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:32:15.824668 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Attempting to bind port b8bbbd88-6455-4786-a740-e30545812074 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:32:15.830132 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Checking agent: {'id': '3abeb35c-bd0f-4d3a-a5fc-c34617de897c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-777031-9-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 15, 12), 'started_at': datetime.datetime(2021, 11, 11, 14, 15, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 32, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-777031-9-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:32:15.834431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Checking segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102269) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:32:15.834431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.834431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Bound using segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} {{(pid=102269) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:32:15.834431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.managers [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Bound port: b8bbbd88-6455-4786-a740-e30545812074, host: dv-cinder-777031-9-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}}] {{(pid=102269) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:32:15.834431 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.873300 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=298c6a9e-8b70-4658-a027-294e132f8325,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:15.876948 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:15.878836 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:15.881297 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:32:15.900498 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] For port b8bbbd88-6455-4786-a740-e30545812074, host dv-cinder-777031-9-iscsi, cleared binding levels {{(pid=102269) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:32:15.903915 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] For port b8bbbd88-6455-4786-a740-e30545812074, host dv-cinder-777031-9-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b8bbbd88-6455-4786-a740-e30545812074,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:32:15.968775 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:15.995134 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-e21cbe1e-1934-4381-9558-01c47313fd0f None None] Provisioning complete for port b8bbbd88-6455-4786-a740-e30545812074 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:15.995610 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e21cbe1e-1934-4381-9558-01c47313fd0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.024683 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.059942 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-e21cbe1e-1934-4381-9558-01c47313fd0f None None] Port b8bbbd88-6455-4786-a740-e30545812074 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:32:16.092450 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.092811 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a8d53c-d053-4394-8d30-266caba1b714 None None] Pushing event updated for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:16.095437 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:16.096046 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:16.212026 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:16.279552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.302969 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:32:16.336939 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.407567 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=298c6a9e-8b70-4658-a027-294e132f8325,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:16.408363 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] Provisioning complete for port b8bbbd88-6455-4786-a740-e30545812074 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:16.408805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.416317 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.473050 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:16.473409 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.482381 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.483822 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-d332eb5e-2b21-4e95-8a62-eb3fa7d9552a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1394482 Nov 11 14:32:16.573130 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.578306 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:15Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:16.636613 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a2e04fc-336b-43c7-9171-65c27f71b767 None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:15Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:32:16.639551 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-8ffdbf07-5dc9-4ad2-aca1-0685c27352b3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-securitygroup--148251393&fields=id&tenant_id=1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 267 time: 0.0462658 Nov 11 14:32:16.669474 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] For port b8bbbd88-6455-4786-a740-e30545812074, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b8bbbd88-6455-4786-a740-e30545812074,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:16.758425 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:16.769690 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a51c351c-fe57-4021-8b2c-18d3922c14a5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:16.771894 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a51c351c-fe57-4021-8b2c-18d3922c14a5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 811 time: 0.1230776 Nov 11 14:32:16.788494 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-941e33b8-5f6c-426a-936e-500cca283eca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/quotas/1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 375 time: 0.0100126 Nov 11 14:32:16.816829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263e359b-04aa-4779-9afc-357bffe872a1 None None] Pushing event updated for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:16.845970 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-007cf3dc-8f03-49f8-bb3e-f16c2590dd2f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0511560 Nov 11 14:32:16.948983 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-f8da0b5c-6683-46ba-8531-35f57ab2f266 service neutron] 10.222.0.10 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910213 Nov 11 14:32:17.047692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-8e820e91-4633-4c7b-bcdd-dc50a2985949 service neutron] 10.222.0.10 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926230 Nov 11 14:32:17.296331 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-75cc7281-df4e-464c-9b44-9caa42539ea0 req-d4ab5fe1-ccae-409a-b54d-a8569ee90445 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 210 time: 0.0298846 Nov 11 14:32:18.308906 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b8bbbd88-6455-4786-a740-e30545812074 up at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:32:18.360430 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Provisioning complete for port b8bbbd88-6455-4786-a740-e30545812074 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:18.360798 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:18.399397 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-653aa659-8ef0-4068-adf4-8ae6841a0038 req-3b494452-57f9-48d2-89dd-bcdc9b5c9820 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 210 time: 0.0310712 Nov 11 14:32:19.323420 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-49969ffb-9bdd-4770-bf61-82f7c75e3e7b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:19.324845 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-49969ffb-9bdd-4770-bf61-82f7c75e3e7b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 811 time: 0.1058948 Nov 11 14:32:19.389189 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-c5b0f697-57df-45b2-946f-02c92e9017a2 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 379 time: 0.0552983 Nov 11 14:32:19.399329 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'port': {'device_id': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'admin_state_up': True, 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'security_groups': ['3c180698-7398-4106-96b0-85ffd84015a7']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:19.508387 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b24b5b24-b964-4ae3-b9a5-5dc7d289f630 req-b1bdf1e0-9476-4922-9e58-5d5f2998a2ae tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 210 time: 0.0399561 Nov 11 14:32:19.576626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Made reservation on behalf of 1dfdd8159d1f45c99f739dea5093090b for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:32:19.580127 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:19.707835 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Allocated IP 172.20.0.8 (c7053be2-46f8-424c-a8b5-3cba0c2fb790/b823154a-6f60-4185-ba89-f69641669a9e/0b721e62-0210-4b18-9adf-83c6bd5b25b8) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:32:19.841506 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:19.937142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:19.978471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:32:19.983404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:32:19.986998 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:32:20.011980 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:20.024766 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.025116 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.025453 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.025785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.026112 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.026443 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.026765 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.027087 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.027435 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.027758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.028073 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.028389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:32:20.050900 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:20.051531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.122678 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-0e1d2673-6c57-42cb-bfc1-16faf9af4390 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7273853 Nov 11 14:32:20.136280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Request body: {'port': {'device_id': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:20.191578 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.211122 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-39cce084-145e-46f5-937c-23746a55f882 None None] Provisioning complete for port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:20.211713 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-39cce084-145e-46f5-937c-23746a55f882 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.244738 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-39cce084-145e-46f5-937c-23746a55f882 None None] Port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:32:20.446684 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0b721e62-0210-4b18-9adf-83c6bd5b25b8 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:32:20.453789 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.465136 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Transition to ACTIVE for port object 0b721e62-0210-4b18-9adf-83c6bd5b25b8 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:32:20.542340 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.628391 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69225b28-f0b2-4951-8153-df245f387a62 req-c0534f94-2a76-4c3e-99ef-cc5c4250b8d7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:20.629973 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-69225b28-f0b2-4951-8153-df245f387a62 req-c0534f94-2a76-4c3e-99ef-cc5c4250b8d7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 943 time: 0.0533116 Nov 11 14:32:20.631212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Pushing event updated for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:20.664268 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Attempting to bind port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:32:20.664611 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Attempting to bind port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:32:20.664924 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Attempting to bind port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:32:20.674527 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:32:20.674916 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Attempting to bind port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:32:20.681074 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 32, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:32:20.681410 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Checking segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:32:20.681785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Bound using segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:32:20.682212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Bound port: 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:32:20.682336 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-69225b28-f0b2-4951-8153-df245f387a62 req-4fa7b878-4661-4793-b7fa-6bdeb5069f3e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454993 Nov 11 14:32:20.682569 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.747085 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:32:20.750158 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:32:20.800148 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.833395 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:20.833985 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:20.835906 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] 10.222.0.11 "PUT /v2.0/ports/0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 1093 time: 0.7045577 Nov 11 14:32:20.836344 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:32:20.838644 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e30417a-eabe-440b-9486-128d29d87303" -d '{"events": [{"name": "network-changed", "server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:32:20.869787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a522b9d7-3190-4337-8693-46a5396750ce service neutron] Pushing event updated for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:20.878265 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:32:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b79e0b4-dfd8-490b-8c6c-c90a77d3e817 x-openstack-request-id: req-4b79e0b4-dfd8-490b-8c6c-c90a77d3e817 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:32:20.878568 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:32:20.878822 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4b79e0b4-dfd8-490b-8c6c-c90a77d3e817 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:32:20.879199 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'status': 'completed', 'code': 200} Nov 11 14:32:20.946950 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e30417a-eabe-440b-9486-128d29d87303 req-66fb63ad-5933-41af-ac3b-841578a2cd98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:20.949120 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4e30417a-eabe-440b-9486-128d29d87303 req-66fb63ad-5933-41af-ac3b-841578a2cd98 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1096 time: 0.0460925 Nov 11 14:32:21.049083 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e30417a-eabe-440b-9486-128d29d87303 req-0366dc16-dee0-43cf-a770-6feda6678c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.050604 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4e30417a-eabe-440b-9486-128d29d87303 req-0366dc16-dee0-43cf-a770-6feda6678c90 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=1dfdd8159d1f45c99f739dea5093090b&shared=False HTTP/1.1" status: 200 len: 912 time: 0.0931039 Nov 11 14:32:21.147687 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e30417a-eabe-440b-9486-128d29d87303 req-57a514ad-2853-486e-b204-f6c6f182809d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.149177 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4e30417a-eabe-440b-9486-128d29d87303 req-57a514ad-2853-486e-b204-f6c6f182809d service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0920885 Nov 11 14:32:21.221483 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-70db4c94-ed66-4a2f-8cc2-4658c802e547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.222945 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-70db4c94-ed66-4a2f-8cc2-4658c802e547 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1096 time: 0.0399156 Nov 11 14:32:21.263069 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-987667cf-ef60-4858-a182-5695f1b7651f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 217 time: 0.0326176 Nov 11 14:32:21.326773 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-71a319fc-ea38-45a6-9541-17b8e49b0e19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.328232 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-71a319fc-ea38-45a6-9541-17b8e49b0e19 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0540369 Nov 11 14:32:21.372584 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-d4682e7f-3190-4cfe-9c72-74771f6aeb69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.374700 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-d4682e7f-3190-4cfe-9c72-74771f6aeb69 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391650 Nov 11 14:32:21.464948 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-616cf26e-4660-4ff7-920e-4a9b1e39e100 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829043 Nov 11 14:32:21.797113 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac1f7f0-f151-41d5-8a48-7569b04d6f68 req-2912e8c3-ea2d-42ab-bc37-b2b5b9849401 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:21.798608 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9ac1f7f0-f151-41d5-8a48-7569b04d6f68 req-2912e8c3-ea2d-42ab-bc37-b2b5b9849401 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 943 time: 0.0482912 Nov 11 14:32:21.803865 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65d4192f-14ad-4cf2-8f0a-68510afc289b req-36776d0d-7244-4fcb-af5d-ea6a73cd0440 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3313627 Nov 11 14:32:21.844889 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9ac1f7f0-f151-41d5-8a48-7569b04d6f68 req-3d41a174-b0b8-4fec-8b1c-caa2e27431c5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404789 Nov 11 14:32:22.958047 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e15e58-8554-43ae-a6c3-0ac63e6448c6 req-13b5cadc-edf6-491c-adea-f9c6f4b6fe3f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:22.960048 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a0e15e58-8554-43ae-a6c3-0ac63e6448c6 req-13b5cadc-edf6-491c-adea-f9c6f4b6fe3f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 943 time: 0.0488703 Nov 11 14:32:23.007968 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a0e15e58-8554-43ae-a6c3-0ac63e6448c6 req-c24332ea-d42e-4dca-a2cf-f06a7498a7f6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421836 Nov 11 14:32:24.123393 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2a2d04-295a-4f29-8429-28fb465690bf req-0b6a5b06-7f53-4254-b641-48b2dccc8dd9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:24.124870 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8e2a2d04-295a-4f29-8429-28fb465690bf req-0b6a5b06-7f53-4254-b641-48b2dccc8dd9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 943 time: 0.0510647 Nov 11 14:32:24.170757 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8e2a2d04-295a-4f29-8429-28fb465690bf req-0d8bcb4d-a7c6-4d45-ad36-c905c3f342b0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401318 Nov 11 14:32:25.076183 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0b721e62-0210-4b18-9adf-83c6bd5b25b8 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:32:25.167910 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:25.178481 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'port_id': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'mac_address': 'fa:16:3e:26:12:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 319, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:32:25.219051 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:25.231308 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0b721e62-0210-4b18-9adf-83c6bd5b25b8 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:32:25.250441 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:25.282830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b6214f-28c8-49ba-8a1d-ee1eedadaabc req-d6454f77-afc4-4747-812a-17ee2561982d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:25.284343 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-45b6214f-28c8-49ba-8a1d-ee1eedadaabc req-d6454f77-afc4-4747-812a-17ee2561982d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 943 time: 0.0480289 Nov 11 14:32:25.325477 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:25.333919 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-45b6214f-28c8-49ba-8a1d-ee1eedadaabc req-b895b57c-ab99-4870-ae93-197e072ca88c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434496 Nov 11 14:32:25.372142 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:25.576196 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['0b721e62-0210-4b18-9adf-83c6bd5b25b8'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:32:26.446532 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def7a39c-bc76-4daa-904a-390daee9fbbd req-8569019f-7654-4a71-b74f-f2553347c3b3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:26.448015 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-def7a39c-bc76-4daa-904a-390daee9fbbd req-8569019f-7654-4a71-b74f-f2553347c3b3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 944 time: 0.0474815 Nov 11 14:32:26.494684 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-def7a39c-bc76-4daa-904a-390daee9fbbd req-20cc8ba6-94ac-4f3f-b793-0e21dfc6b927 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409863 Nov 11 14:32:27.083088 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0b721e62-0210-4b18-9adf-83c6bd5b25b8 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:32:27.203758 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:32:27.207325 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:32:27.207726 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:27.282345 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:27.307549 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:32:27.309734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ccba27e-7298-4033-a4e0-322a8b727022" -d '{"events": [{"server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "name": "network-vif-plugged", "status": "completed", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:32:27.439632 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:32:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8cf3ecb-f5ed-4eda-a262-3e48e28cba4a x-openstack-request-id: req-e8cf3ecb-f5ed-4eda-a262-3e48e28cba4a {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:32:27.439917 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "name": "network-vif-plugged", "status": "completed", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:32:27.440162 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-e8cf3ecb-f5ed-4eda-a262-3e48e28cba4a {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:32:27.440537 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'code': 200} Nov 11 14:32:27.442133 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:32:27.502734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:27.550418 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:32:27.612329 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109fae4d-53a0-440c-9918-36f0e347ba9c req-68d100fc-7464-45eb-9619-40c23e0ded60 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:27.613695 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-109fae4d-53a0-440c-9918-36f0e347ba9c req-68d100fc-7464-45eb-9619-40c23e0ded60 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0512831 Nov 11 14:32:27.642684 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0e1460-7cd5-48cd-9967-530259ef4492 req-4e7ba18f-9ddb-433f-8286-de5c6a587a1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:27.644242 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2b0e1460-7cd5-48cd-9967-530259ef4492 req-4e7ba18f-9ddb-433f-8286-de5c6a587a1c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1098 time: 0.0391037 Nov 11 14:32:27.661822 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-109fae4d-53a0-440c-9918-36f0e347ba9c req-d02130a1-cc46-451a-8876-41ff34d0f32c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416963 Nov 11 14:32:27.688523 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2b0e1460-7cd5-48cd-9967-530259ef4492 req-f38ceb3c-aa70-4be9-862f-4a636f56099d service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377755 Nov 11 14:32:28.779446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb5e1530-f0d7-4ac7-b0a5-4c5e83db7014 req-8cb8458c-fcd1-4e46-bbb9-9e26d6b45582 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:28.780957 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb5e1530-f0d7-4ac7-b0a5-4c5e83db7014 req-8cb8458c-fcd1-4e46-bbb9-9e26d6b45582 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0515978 Nov 11 14:32:28.828646 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-eb5e1530-f0d7-4ac7-b0a5-4c5e83db7014 req-897d11cc-00f9-40ca-b66c-9085a8c20e30 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415225 Nov 11 14:32:29.941257 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62295e3d-a2c4-4142-aebf-b745161e7e34 req-8d3e1245-58a5-4364-a85f-ebaa42a8b075 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:29.942687 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-62295e3d-a2c4-4142-aebf-b745161e7e34 req-8d3e1245-58a5-4364-a85f-ebaa42a8b075 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0478764 Nov 11 14:32:29.988353 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-62295e3d-a2c4-4142-aebf-b745161e7e34 req-24acd9b5-5778-457b-96aa-594fe68b71e3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398955 Nov 11 14:32:30.096739 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91da577-e1dc-46e3-b430-e922a298ba29 req-15642447-51bc-46b2-aaa3-5fb946793192 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:30.098175 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c91da577-e1dc-46e3-b430-e922a298ba29 req-15642447-51bc-46b2-aaa3-5fb946793192 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0473552 Nov 11 14:32:30.106712 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38636) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:32:30.111143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'floatingip': {'port_id': '0b721e62-0210-4b18-9adf-83c6bd5b25b8'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:32:30.152613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:30.571795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:30.605331 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:30.702343 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Floating IP 75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6 associated. External IP: 172.27.1.55, port: 0b721e62-0210-4b18-9adf-83c6bd5b25b8. Nov 11 14:32:30.908740 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:32:31.018413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:32:31.023272 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:31.029451 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:32:31.040272 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:31.040913 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:31.049873 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e6900f2e-6983-44d3-944f-ca57feee47e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "PUT /v2.0/floatingips/75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6 HTTP/1.1" status: 200 len: 990 time: 0.9421127 Nov 11 14:32:31.050465 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:32:31.062479 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37a54c8c-1c20-4629-af28-855cc7e731f3" -d '{"events": [{"name": "network-changed", "server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:32:31.105531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:32:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9aef53fe-b02e-415e-b4ad-f02e86962dac x-openstack-request-id: req-9aef53fe-b02e-415e-b4ad-f02e86962dac {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:32:31.106144 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:32:31.106144 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-9aef53fe-b02e-415e-b4ad-f02e86962dac {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:32:31.106450 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'status': 'completed', 'code': 200} Nov 11 14:32:31.147177 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:31.172670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-bf029af2-cf82-4cb7-981f-d60fe68d116f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:31.174260 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-bf029af2-cf82-4cb7-981f-d60fe68d116f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1098 time: 0.0405300 Nov 11 14:32:31.267334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-9e501e40-2544-4d59-9afa-ff24f00125f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:31.268842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-9e501e40-2544-4d59-9afa-ff24f00125f2 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.0858693 Nov 11 14:32:31.332833 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-afb0d233-70c6-4c15-b100-fd5690241450 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 998 time: 0.0561070 Nov 11 14:32:31.367715 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.55', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:26:12:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:32:15Z', 'updated_at': '2021-11-11T14:32:30Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:31.387714 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-c5e8a9d0-0030-44c8-b8a2-a7db72b9ceb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:31.389146 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-c5e8a9d0-0030-44c8-b8a2-a7db72b9ceb0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0488951 Nov 11 14:32:31.397379 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:32:31.405958 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:32:31.406549 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:32:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:31.435383 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-bdaec143-0cd3-4335-9899-a11265ba62a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:31.436923 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-bdaec143-0cd3-4335-9899-a11265ba62a1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390491 Nov 11 14:32:31.509491 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:32:31.527705 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-54361c20-d617-48ee-80b6-3b7c03e59ff5 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822527 Nov 11 14:32:31.626107 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-37a54c8c-1c20-4629-af28-855cc7e731f3 req-a3b77d8f-3597-4aa8-b921-1b224369b46b service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908222 Nov 11 14:32:31.820975 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.55', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:26:12:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:32:15Z', 'updated_at': '2021-11-11T14:32:30Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:32:31.849199 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c5d3ac4-2046-4af8-8885-dd672351cd6d None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.55', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 641, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:26:12:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:32:15Z', 'updated_at': '2021-11-11T14:32:30Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:32:32.033351 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b585522-94df-48ef-875e-33a788e5d6b9 None None] New status for floating IP 75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6: ACTIVE {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:32:36.021778 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1a3730f9-bc7e-4ef3-a2be-04f81c9b4db8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:38.433459 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-984b5fda-1327-48eb-a1bc-45ede464654a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:39.643675 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:40.347493 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:32:40.753338 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:41.723296 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:42.148462 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:32:45.783757 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-91291d72-0c3c-494e-9966-27815263db36 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407748 Nov 11 14:32:45.866059 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-d6f2d9dd-fb19-4e40-90a1-b377ef53f0ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:45.867543 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-d6f2d9dd-fb19-4e40-90a1-b377ef53f0ab service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1098 time: 0.0422354 Nov 11 14:32:45.970226 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-08e96c20-1fa6-47a0-9ee2-a6e680cfac20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:45.971728 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-08e96c20-1fa6-47a0-9ee2-a6e680cfac20 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.0856957 Nov 11 14:32:46.037872 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-96d11bb3-9972-4e46-934d-aab6ca77a9db service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 1001 time: 0.0591486 Nov 11 14:32:46.085162 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-baa8e38a-d8c7-44e9-9660-78d452de4e7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:46.086555 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-baa8e38a-d8c7-44e9-9660-78d452de4e7e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0417953 Nov 11 14:32:46.131894 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-78e3858c-a922-426a-aa7c-d81340e4e8a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:32:46.133477 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-78e3858c-a922-426a-aa7c-d81340e4e8a6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393174 Nov 11 14:32:46.223771 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-25e92c13-ce65-44f8-bc52-bf4f3e1f3187 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821536 Nov 11 14:32:46.310272 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a6216490-6023-41ea-a2ac-072e2e9deb9d req-541bee81-0c6a-48a7-b0c4-71be91c06b0e service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797396 Nov 11 14:33:06.038656 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7274a27a-7413-44f5-9935-7c0d3bda66a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:08.438922 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b46983b5-3975-4bd1-b5e6-4e2e009ed759 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:09.633607 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:10.775991 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:11.728484 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:12.141525 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.449072 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38748) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:14.603943 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port 3408179d-404c-4cfb-a0ec-6bfd70f97f2d {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:14.604274 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.682896 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.683218 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.694570 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for 3408179d-404c-4cfb-a0ec-6bfd70f97f2d owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:14.900145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.924907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=3408179d-404c-4cfb-a0ec-6bfd70f97f2d,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:14.982654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:14.982977 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP 56470eac-d56e-4bc1-89a9-5065353243c7 disassociated (deleted). External IP: 172.27.1.48, port: a0b2185b-e65b-4bed-940b-d8aa4cec73ef. Nov 11 14:33:15.183666 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:33:15.287143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:33:15.291955 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:15.296564 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:33:15.305882 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:15.306476 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:15.318351 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-7729c519-0c4f-4a5f-a3fe-472e1c3e08b5 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "DELETE /v2.0/floatingips/56470eac-d56e-4bc1-89a9-5065353243c7 HTTP/1.1" status: 204 len: 168 time: 0.8682263 Nov 11 14:33:15.319030 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:33:15.322098 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-295392be-40f3-4413-9a74-9e1f4bf2ad30" -d '{"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:33:15.358830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:33:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81ea4fd2-02f0-481e-b47f-31b8588c634a x-openstack-request-id: req-81ea4fd2-02f0-481e-b47f-31b8588c634a {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:33:15.359114 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:33:15.359381 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-81ea4fd2-02f0-481e-b47f-31b8588c634a {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:33:15.359817 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'status': 'completed', 'code': 200} Nov 11 14:33:15.412458 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:15.423693 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-38d59d9c-3e49-48ec-8485-bca770d3de6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:15.425378 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-38d59d9c-3e49-48ec-8485-bca770d3de6c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 1098 time: 0.0407057 Nov 11 14:33:15.517989 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-618259f6-f5e5-4438-bf03-331b3f97e7b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:15.519388 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-618259f6-f5e5-4438-bf03-331b3f97e7b0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.0873539 Nov 11 14:33:15.562066 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-6993f9de-0b57-499b-a2ed-74f72a4f96c8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef HTTP/1.1" status: 200 len: 217 time: 0.0351899 Nov 11 14:33:15.622553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-04ab8a58-b863-4d94-a2da-d602c21ff6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:15.625164 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-04ab8a58-b863-4d94-a2da-d602c21ff6bc service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0543914 Nov 11 14:33:15.644454 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:15.669833 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-50208cc9-7d2e-4634-8a2d-bb98b8d9033e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:15.671308 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:33:15.671482 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-50208cc9-7d2e-4634-8a2d-bb98b8d9033e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403705 Nov 11 14:33:15.679567 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:15.680149 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:15.765998 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-c4c8e9a7-6268-4082-997d-5271a70230a1 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878570 Nov 11 14:33:15.787022 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:15.801582 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e13f0f-8f8d-40a4-b326-37f8769c1953 req-505e58a0-ff91-4762-beed-6a34c0eac4c3 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:15.803649 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c4e13f0f-8f8d-40a4-b326-37f8769c1953 req-505e58a0-ff91-4762-beed-6a34c0eac4c3 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0505033 Nov 11 14:33:15.863065 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c4e13f0f-8f8d-40a4-b326-37f8769c1953 req-496fdcea-829e-4372-9185-7af38ecc2292 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526011 Nov 11 14:33:15.871636 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-295392be-40f3-4413-9a74-9e1f4bf2ad30 req-62ed3f20-8510-4fe3-a032-286c6aa2cca0 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0972106 Nov 11 14:33:16.018684 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-3c363024-40ec-4d06-867f-992726b59811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:16.045133 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c363024-40ec-4d06-867f-992726b59811 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '310ebba1-233e-43f6-9a3c-4d5402f5ba23', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'floating_ip_address': '172.27.1.108', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '589db83d-340f-42a5-815b-afa42568542b', 'port_id': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 510, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'mac_address': 'fa:16:3e:6f:fd:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:29:10Z', 'updated_at': '2021-11-11T14:29:13Z', 'revision_number': 1, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:33:16.250786 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-220018c5-f8ec-40b2-a681-309798e48557 None None] New status for floating IP 56470eac-d56e-4bc1-89a9-5065353243c7: DOWN {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:33:16.979754 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9094a1-2f8c-4e8b-8ad7-7528d53e4084 req-d3ebdb6e-208b-4c47-9b5b-1b633ad337a4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:16.981217 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d9094a1-2f8c-4e8b-8ad7-7528d53e4084 req-d3ebdb6e-208b-4c47-9b5b-1b633ad337a4 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0473158 Nov 11 14:33:17.028650 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d9094a1-2f8c-4e8b-8ad7-7528d53e4084 req-708343e1-cad6-481f-b3e6-30b923c4365b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416691 Nov 11 14:33:17.247263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-c4cb03e9-4b66-4178-a84a-a81ff68d31d0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:17.248690 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-c4cb03e9-4b66-4178-a84a-a81ff68d31d0 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 945 time: 0.0502336 Nov 11 14:33:17.335497 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port a0b2185b-e65b-4bed-940b-d8aa4cec73ef {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:17.335830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:17.345247 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:33:17.423616 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] For port a0b2185b-e65b-4bed-940b-d8aa4cec73ef, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:17.423991 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:17.679205 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for a0b2185b-e65b-4bed-940b-d8aa4cec73ef owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:17.882397 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:17.911759 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=a0b2185b-e65b-4bed-940b-d8aa4cec73ef,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:17.952907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] No DVR routers for this DVR port a0b2185b-e65b-4bed-940b-d8aa4cec73ef on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:17.956912 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:17.958911 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-67113e50-8c29-48c2-8b33-95cd5f15a834 req-a910e81b-a2f5-4343-bc2c-76c5846f2bf7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "DELETE /v2.0/ports/a0b2185b-e65b-4bed-940b-d8aa4cec73ef HTTP/1.1" status: 204 len: 173 time: 0.7037811 Nov 11 14:33:17.959392 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'name': 'network-vif-deleted', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:33:17.961678 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-babc5961-0469-42a6-a084-52fb8323a8cd" -d '{"events": [{"server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "name": "network-vif-deleted", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:33:18.040828 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:33:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c84d0eb9-de1f-484e-bbcc-fcfdc1fab7a6 x-openstack-request-id: req-c84d0eb9-de1f-484e-bbcc-fcfdc1fab7a6 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:33:18.041413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "83d39445-a054-4387-ae24-143171a79c3c", "name": "network-vif-deleted", "tag": "a0b2185b-e65b-4bed-940b-d8aa4cec73ef", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:33:18.041413 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-c84d0eb9-de1f-484e-bbcc-fcfdc1fab7a6 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:33:18.041906 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '83d39445-a054-4387-ae24-143171a79c3c', 'name': 'network-vif-deleted', 'tag': 'a0b2185b-e65b-4bed-940b-d8aa4cec73ef', 'status': 'completed', 'code': 200} Nov 11 14:33:18.121621 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-be3fbc40-4e53-48ce-9678-755979506087 req-d59754d8-b41c-43eb-a0e8-64c86e9e0326 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0261202 Nov 11 14:33:19.168536 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ebb65a-0c4b-4ce6-b41d-c9c89e7978de req-7a66c03c-47d1-40f6-9659-857d080e6ac9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:19.170016 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-91ebb65a-0c4b-4ce6-b41d-c9c89e7978de req-7a66c03c-47d1-40f6-9659-857d080e6ac9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0511851 Nov 11 14:33:19.218077 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-91ebb65a-0c4b-4ce6-b41d-c9c89e7978de req-416138fb-36fb-461b-9c67-d232b5a0d4c3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419307 Nov 11 14:33:19.240692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-00889fbd-d196-4c5c-b886-3eb905e9eda5 req-ed1e09e3-91d3-45de-a20d-41aa6ecc19d7 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=83d39445-a054-4387-ae24-143171a79c3c HTTP/1.1" status: 200 len: 210 time: 0.0350430 Nov 11 14:33:20.338987 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0e417f-1c61-4ad0-9e9c-325759c09461 req-b4488de5-d07c-4438-bb69-af2d0c9f8867 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:20.343000 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4b0e417f-1c61-4ad0-9e9c-325759c09461 req-b4488de5-d07c-4438-bb69-af2d0c9f8867 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0542562 Nov 11 14:33:20.396502 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4b0e417f-1c61-4ad0-9e9c-325759c09461 req-d7b36941-0e2a-4ded-84cb-6190366e1639 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455799 Nov 11 14:33:21.363381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0b2185b-e65b-4bed-940b-d8aa4cec73ef no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:21.387011 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: a0b2185b-e65b-4bed-940b-d8aa4cec73ef {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:21.387339 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0b2185b-e65b-4bed-940b-d8aa4cec73ef not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:21.511132 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c6c7d2-27fb-4ef6-b098-53cba196d4ef req-3f095b5f-5d33-4ef3-9086-04d7b5ff054f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:21.512633 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-67c6c7d2-27fb-4ef6-b098-53cba196d4ef req-3f095b5f-5d33-4ef3-9086-04d7b5ff054f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0498614 Nov 11 14:33:21.560769 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-67c6c7d2-27fb-4ef6-b098-53cba196d4ef req-0aa02f4d-26a0-4b98-a079-009c5fb629dc tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419996 Nov 11 14:33:22.680919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38802) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:22.682128 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3387584-bdff-4696-a0a8-9d2c6863e18b req-8b20b9ef-4570-4a4a-a120-86d59aa9e587 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:22.683818 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d3387584-bdff-4696-a0a8-9d2c6863e18b req-8b20b9ef-4570-4a4a-a120-86d59aa9e587 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0547919 Nov 11 14:33:22.731132 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d3387584-bdff-4696-a0a8-9d2c6863e18b req-799e2868-4142-47d4-960f-3319e8d347a8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408962 Nov 11 14:33:22.834428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port 6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:22.834754 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:22.910264 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:22.910500 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:22.922276 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for 6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5 owned by network:floatingip {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:23.419647 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:23.442445 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=6b6a31a4-6edd-4c6b-a686-1ad8ed9451b5,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:23.452080 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.452424 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.452758 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.453087 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.453412 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.454303 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.454303 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.454499 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.454661 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.454978 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.455295 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.455633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:23.512756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:23.513076 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Floating IP 310ebba1-233e-43f6-9a3c-4d5402f5ba23 disassociated (deleted). External IP: 172.27.1.108, port: b5393ed5-0b79-4d8b-a871-98e4a84d0246. Nov 11 14:33:23.719236 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:33:23.853250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:33:23.859386 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:23.862845 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:33:23.874180 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:23.874788 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:23.892799 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c6bc9a9-5cf2-49d0-93ae-a794c787834f req-9343132c-baa7-48a9-af6f-4a40b4ef16e7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:23.894271 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c6bc9a9-5cf2-49d0-93ae-a794c787834f req-9343132c-baa7-48a9-af6f-4a40b4ef16e7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0896242 Nov 11 14:33:23.904378 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-643094c7-d14b-4c2c-9ff3-9269f0832f07 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "DELETE /v2.0/floatingips/310ebba1-233e-43f6-9a3c-4d5402f5ba23 HTTP/1.1" status: 204 len: 168 time: 1.2224538 Nov 11 14:33:23.908913 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:33:23.911069 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c" -d '{"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:33:23.953822 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1c6bc9a9-5cf2-49d0-93ae-a794c787834f req-56d2c6f0-f3b4-4ca5-8fbe-a1979e8bbdcf tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526128 Nov 11 14:33:23.996917 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:24.007060 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:33:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ebcbb77-c195-4f85-a578-e652e53e13bb x-openstack-request-id: req-3ebcbb77-c195-4f85-a578-e652e53e13bb {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:33:24.007471 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:33:24.007782 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-3ebcbb77-c195-4f85-a578-e652e53e13bb {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:33:24.008183 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'status': 'completed', 'code': 200} Nov 11 14:33:24.070985 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-46efc035-5f98-41e0-b390-5d6601506311 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:24.072536 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-46efc035-5f98-41e0-b390-5d6601506311 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 1098 time: 0.0432539 Nov 11 14:33:24.165402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-a4882161-b938-493f-99e4-3eee2775e054 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:24.167026 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-a4882161-b938-493f-99e4-3eee2775e054 service neutron] 10.222.0.11 "GET /v2.0/networks?id=4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 200 len: 912 time: 0.0862439 Nov 11 14:33:24.197983 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:24.213838 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-3c639995-d9a1-4f7d-a02a-a708ac7d40fb service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 200 len: 217 time: 0.0372498 Nov 11 14:33:24.227570 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:33:24.236212 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:24.236804 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:24.263979 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-a0f83cb2-882f-483c-b166-a04552a35b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:24.265480 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-a0f83cb2-882f-483c-b166-a04552a35b4a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 200 len: 850 time: 0.0439477 Nov 11 14:33:24.314944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-4874954b-8e6d-46d7-83aa-e34fc0996814 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:24.316524 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-4874954b-8e6d-46d7-83aa-e34fc0996814 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=4bad907f-fd8e-4849-9ded-63b7501aff2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438805 Nov 11 14:33:24.367135 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562cd1d9-5dbe-49de-9d13-b7cd26a54a8a req-d5e6b093-2dd5-455c-91ea-00bbcac4d68b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:24.368805 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-562cd1d9-5dbe-49de-9d13-b7cd26a54a8a req-d5e6b093-2dd5-455c-91ea-00bbcac4d68b tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0539250 Nov 11 14:33:24.417119 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-3edad92e-69f7-4af4-a220-1c37a4b51fa2 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919511 Nov 11 14:33:24.423590 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-562cd1d9-5dbe-49de-9d13-b7cd26a54a8a req-8cf07a22-3486-4aa1-9067-2967a60465b6 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475919 Nov 11 14:33:24.430463 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:24.507664 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0ba9149f-e87a-42f7-a4fb-8f4f7081e15c req-1abfc0c1-8b11-4e15-bb1d-e1c378a08421 service neutron] 10.222.0.11 "GET /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826917 Nov 11 14:33:24.622554 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:24.648272 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36af9f95-868d-41c1-86d6-d108c3197a84 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:25:02Z', 'revision_number': 4, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '46ec5320-e817-479c-a4c6-cd8e78c306de', 'name': '', 'network_id': '4bad907f-fd8e-4849-9ded-63b7501aff2a', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'mac_address': 'fa:16:3e:4d:9a:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_interface', 'standard_attr_id': 280, 'fixed_ips': [{'subnet_id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:01Z', 'updated_at': '2021-11-11T14:25:08Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'subnets': [{'id': '2b677022-3ca7-40d0-ba96-f88e6df9c517', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:33:24.850919 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25ca4926-1493-4084-99ad-9fdab169c103 None None] New status for floating IP 310ebba1-233e-43f6-9a3c-4d5402f5ba23: DOWN {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:33:25.069480 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0713ec-5124-4a85-a0b8-718738ac5222 req-452bcbc5-77bb-4bf7-ad37-7723d43c69db tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:25.070865 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc0713ec-5124-4a85-a0b8-718738ac5222 req-452bcbc5-77bb-4bf7-ad37-7723d43c69db tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0487139 Nov 11 14:33:25.123411 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cc0713ec-5124-4a85-a0b8-718738ac5222 req-3a43ff79-67ea-4dfb-8da9-5f3cdd7d98a5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432599 Nov 11 14:33:25.538613 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b042d7-d94d-4b5e-9f82-1da63f607faa req-56f57862-7a2c-4721-a996-55cee7f56125 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:25.540072 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-50b042d7-d94d-4b5e-9f82-1da63f607faa req-56f57862-7a2c-4721-a996-55cee7f56125 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0506949 Nov 11 14:33:25.588036 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-50b042d7-d94d-4b5e-9f82-1da63f607faa req-9943c35f-025a-4f31-89ea-f6cb95eb4e90 tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/security-groups?id=2cfa354d-b685-49ff-add6-9fea82052f27&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415874 Nov 11 14:33:25.801368 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c792d86f-d864-4795-83a9-8e47d8203094 req-79103cef-16c7-4639-89a1-87304ee5c9ee tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:25.802721 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c792d86f-d864-4795-83a9-8e47d8203094 req-79103cef-16c7-4639-89a1-87304ee5c9ee tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 945 time: 0.0490034 Nov 11 14:33:25.890674 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port b5393ed5-0b79-4d8b-a871-98e4a84d0246 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:25.891008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:25.982303 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] For port b5393ed5-0b79-4d8b-a871-98e4a84d0246, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=b5393ed5-0b79-4d8b-a871-98e4a84d0246,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:25.982662 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:25.994795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for b5393ed5-0b79-4d8b-a871-98e4a84d0246 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:26.181385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:26.221643 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=b5393ed5-0b79-4d8b-a871-98e4a84d0246,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:26.259830 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.260191 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.260527 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.260859 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.261246 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.262535 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.262535 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.262735 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.263008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.263325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.263921 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.264232 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:26.291487 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] No DVR routers for this DVR port b5393ed5-0b79-4d8b-a871-98e4a84d0246 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:26.294276 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:26.299438 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c792d86f-d864-4795-83a9-8e47d8203094 req-4e2525de-4f18-48b0-afb8-616a3640c8ef tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.11 "DELETE /v2.0/ports/b5393ed5-0b79-4d8b-a871-98e4a84d0246 HTTP/1.1" status: 204 len: 173 time: 0.4908912 Nov 11 14:33:26.300718 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'name': 'network-vif-deleted', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:33:26.302954 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ecea6de-a924-4f03-8675-f542de4527ce" -d '{"events": [{"server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "name": "network-vif-deleted", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:33:26.317655 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8363f939-cdb8-487d-a23a-caea798d912b req-c9dd472f-1cb7-4eeb-8953-56270624750c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:26.322210 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8363f939-cdb8-487d-a23a-caea798d912b req-c9dd472f-1cb7-4eeb-8953-56270624750c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.1320937 Nov 11 14:33:26.341162 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:33:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-394128d5-3cef-40fc-a0e2-28a016e9d783 x-openstack-request-id: req-394128d5-3cef-40fc-a0e2-28a016e9d783 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:33:26.341446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad8c14bc-91c6-47da-8c12-dd40d9c4f32d", "name": "network-vif-deleted", "tag": "b5393ed5-0b79-4d8b-a871-98e4a84d0246", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:33:26.341690 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-394128d5-3cef-40fc-a0e2-28a016e9d783 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:33:26.342068 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad8c14bc-91c6-47da-8c12-dd40d9c4f32d', 'name': 'network-vif-deleted', 'tag': 'b5393ed5-0b79-4d8b-a871-98e4a84d0246', 'status': 'completed', 'code': 200} Nov 11 14:33:26.372053 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8363f939-cdb8-487d-a23a-caea798d912b req-c2e2b64f-3e88-44a5-8cb7-57d8c7897e91 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462885 Nov 11 14:33:26.691549 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dd1179c9-c6cf-4eef-97f1-0dcd736e617f req-cf9c3ab9-c8cb-4b92-b97d-0a6287afcefa tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "GET /v2.0/ports?device_id=ad8c14bc-91c6-47da-8c12-dd40d9c4f32d HTTP/1.1" status: 200 len: 210 time: 0.0276303 Nov 11 14:33:27.488726 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee30095-7abc-4e70-b632-2515abdeef21 req-bd12fa40-bfe9-4638-a456-c927e54b3250 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:27.490223 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6ee30095-7abc-4e70-b632-2515abdeef21 req-bd12fa40-bfe9-4638-a456-c927e54b3250 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0492387 Nov 11 14:33:27.536971 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6ee30095-7abc-4e70-b632-2515abdeef21 req-b67d354b-86c8-43c0-9922-1df0f9965987 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408082 Nov 11 14:33:27.755910 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38826) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:27.875813 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Deleting port 1b977a10-3647-4111-a2a8-5568fd629dd4 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:27.876139 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:27.957612 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:27.957935 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:27.969308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Calling delete_port for 1b977a10-3647-4111-a2a8-5568fd629dd4 owned by network:floatingip {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:28.186958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:28.209919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'Port': ['ID=1b977a10-3647-4111-a2a8-5568fd629dd4,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:28.274620 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for floatingip, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:28.277083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:28.278206 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-767b102c-d35c-440e-a4b9-1c81db1930dd tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "DELETE /v2.0/floatingips/a694a2ce-d3e1-4299-958e-45c6bc8c4054 HTTP/1.1" status: 204 len: 168 time: 0.5213032 Nov 11 14:33:28.652553 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bbebcc5-2837-4cf0-8936-e0c318fb2fef req-5ce01498-7d20-4476-972f-fc5c09d08e34 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:28.654323 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8bbebcc5-2837-4cf0-8936-e0c318fb2fef req-5ce01498-7d20-4476-972f-fc5c09d08e34 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0484846 Nov 11 14:33:28.718028 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8bbebcc5-2837-4cf0-8936-e0c318fb2fef req-3a8be262-b91d-4914-beea-4bbb0263b7da tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540597 Nov 11 14:33:29.376462 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device b5393ed5-0b79-4d8b-a871-98e4a84d0246 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:29.396369 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: b5393ed5-0b79-4d8b-a871-98e4a84d0246 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:29.396709 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device b5393ed5-0b79-4d8b-a871-98e4a84d0246 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:29.631952 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38840) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:29.687503 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:29.716043 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:29.836639 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcff2a2-7f78-4f0f-9961-170c241fe6e7 req-158bf279-4f36-4e94-b473-5d4a1344a670 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:29.838187 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5bcff2a2-7f78-4f0f-9961-170c241fe6e7 req-158bf279-4f36-4e94-b473-5d4a1344a670 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0513492 Nov 11 14:33:29.869326 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:29.872434 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:29.882620 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] 10.222.0.10 "DELETE /v2.0/security-groups/2cfa354d-b685-49ff-add6-9fea82052f27 HTTP/1.1" status: 204 len: 168 time: 0.2404833 Nov 11 14:33:29.893892 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce320c83-ae2f-4f46-bb36-c3e7eb97736f tempest-TestVolumeBootPattern-821674145 tempest-TestVolumeBootPattern-821674145-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cfa354d-b685-49ff-add6-9fea82052f27,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:29.899012 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5bcff2a2-7f78-4f0f-9961-170c241fe6e7 req-c77d9477-fea5-4ac0-99de-942cb6608ac1 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541122 Nov 11 14:33:29.999128 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38846) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:30.377868 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:30.616206 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Deleting port 46ec5320-e817-479c-a4c6-cd8e78c306de {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:30.616453 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:30.695532 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] For port 46ec5320-e817-479c-a4c6-cd8e78c306de, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=46ec5320-e817-479c-a4c6-cd8e78c306de,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:30.696214 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:30.708325 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Calling delete_port for 46ec5320-e817-479c-a4c6-cd8e78c306de owned by network:router_interface {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:30.994045 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:31.026398 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Pushing event deleted for resources: {'Port': ['ID=46ec5320-e817-479c-a4c6-cd8e78c306de,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:31.083890 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db76fbb-dbb9-47db-b894-3b315666da6c req-9f62f979-da71-4f6c-871c-07da15fcc52e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:31.085501 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6db76fbb-dbb9-47db-b894-3b315666da6c req-9f62f979-da71-4f6c-871c-07da15fcc52e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.1166399 Nov 11 14:33:31.161115 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6db76fbb-dbb9-47db-b894-3b315666da6c req-f2f52a64-1040-4fc2-ab27-c8befe0146c9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0664096 Nov 11 14:33:31.266944 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:31.482745 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Router 589db83d-340f-42a5-815b-afa42568542b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:33:31.587247 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:33:31.597408 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-98a6d1de-5c32-42e0-b91c-fd60d2f494cb admin admin] 10.222.0.10 "PUT /v2.0/routers/589db83d-340f-42a5-815b-afa42568542b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5925806 Nov 11 14:33:31.597408 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38852) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:31.598156 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Sync routers for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:33:31.609219 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:31.609822 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:31.713681 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:31.896782 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:33:30Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:31.927497 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Checking router: 589db83d-340f-42a5-815b-afa42568542b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:33:31.936930 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Routers {'589db83d-340f-42a5-815b-afa42568542b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:31.937544 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['589db83d-340f-42a5-815b-afa42568542b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:31.949006 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks [] for router, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.047505 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.048572 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] Set router 589db83d-340f-42a5-815b-afa42568542b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:32.181782 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Deleting port b037cf4d-0426-4c96-9e8b-fb99b6d7899f {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:32.182116 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.225889 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:33:30Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:32.252517 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-294100cf-5aba-4392-9db0-f87a477087d1 None None] The sync data for ids ['589db83d-340f-42a5-815b-afa42568542b'] in dv-cinder-777031-9-iscsi is: [{'id': '589db83d-340f-42a5-815b-afa42568542b', 'name': 'tempest-TestVolumeBootPattern-975802405-router', 'tenant_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:24:56Z', 'updated_at': '2021-11-11T14:33:30Z', 'revision_number': 5, 'project_id': '2d09ad6536ff49c4b4e43c8239742bc5', 'gw_port': {'id': 'b037cf4d-0426-4c96-9e8b-fb99b6d7899f', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:fc:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '589db83d-340f-42a5-815b-afa42568542b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 270, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:24:57Z', 'updated_at': '2021-11-11T14:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:33:32.268221 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] For port b037cf4d-0426-4c96-9e8b-fb99b6d7899f, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:32.268636 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.275677 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09590663-6fd8-424d-907e-8999c3edc46b req-70edd0b1-d59a-45c0-aa5f-08814859fee1 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:32.277201 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-09590663-6fd8-424d-907e-8999c3edc46b req-70edd0b1-d59a-45c0-aa5f-08814859fee1 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0533876 Nov 11 14:33:32.283544 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Calling delete_port for b037cf4d-0426-4c96-9e8b-fb99b6d7899f owned by network:router_gateway {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:32.338332 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-09590663-6fd8-424d-907e-8999c3edc46b req-5b972bf0-8c02-40ff-8f7a-ebebb06f273a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465014 Nov 11 14:33:32.504968 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.531741 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Pushing event deleted for resources: {'Port': ['ID=b037cf4d-0426-4c96-9e8b-fb99b6d7899f,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:32.591200 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.685771 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.688260 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.781377 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.781947 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 589db83d-340f-42a5-815b-afa42568542b {{(pid=102268) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:33:32.786460 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.787663 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8749d192-0b2d-4191-acc8-f604573dd11b admin admin] 10.222.0.10 "DELETE /v2.0/routers/589db83d-340f-42a5-815b-afa42568542b HTTP/1.1" status: 204 len: 168 time: 1.1913528 Nov 11 14:33:32.790058 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38856) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:32.836105 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Deleting subnet 2b677022-3ca7-40d0-ba96-f88e6df9c517 {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:33:32.839439 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.878797 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129741504'] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:32.956652 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.082608 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-125906296', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-129288619'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.111911 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2b677022-3ca7-40d0-ba96-f88e6df9c517,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:33.115383 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.118527 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-4e1cac68-a955-4a2f-b35d-3b0499d25384 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/2b677022-3ca7-40d0-ba96-f88e6df9c517 HTTP/1.1" status: 204 len: 168 time: 0.3274930 Nov 11 14:33:33.121429 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38858) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:33.122998 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-606328b0-beed-4198-8309-e85dde56e86b None None] Network 4bad907f-fd8e-4849-9ded-63b7501aff2a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:33:33.189413 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.243849 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Deleting port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:33.244180 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.308791 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] DHCP port deletion for 4bad907f-fd8e-4849-9ded-63b7501aff2a request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:33:33.320349 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] For port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:33.320731 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.334119 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Calling delete_port for 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:33.356209 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Deleting port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:33.356579 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.428267 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] For port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,segment=NetworkSegment(da028d45-e079-4155-9323-70c10aaac9cf),segment_id=da028d45-e079-4155-9323-70c10aaac9cf)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:33.428657 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.441165 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Calling delete_port for 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:33.456236 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480508de-2b95-49f6-b260-e20a9fe88e9a req-e23b2597-0606-425d-86ff-c8abc9cd89a6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:33.457693 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-480508de-2b95-49f6-b260-e20a9fe88e9a req-e23b2597-0606-425d-86ff-c8abc9cd89a6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0500576 Nov 11 14:33:33.504164 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.522986 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.531932 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-480508de-2b95-49f6-b260-e20a9fe88e9a req-8987ddaa-597e-47e4-898a-e98db92a67d2 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0684559 Nov 11 14:33:33.534917 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:33.538129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] No DVR routers for this DVR port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:33.553648 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Pushing event deleted for resources: {'Port': ['ID=3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:33.554897 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.555243 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.555612 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.555932 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.556262 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.556585 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.556905 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.557226 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.557546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.557902 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.558219 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.558534 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:33:33.561160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eef92fb7-40f7-41fe-a21a-2355378cb376 None None] No DVR routers for this DVR port 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:33.614897 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.634068 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4bad907f-fd8e-4849-9ded-63b7501aff2a']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:33.644304 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'da028d45-e079-4155-9323-70c10aaac9cf') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:33.644592 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'da028d45-e079-4155-9323-70c10aaac9cf') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:33.654613 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.667502 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.673192 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Releasing vlan 329 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:33:33.673552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:33:33.675141 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:33:33.792465 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.797633 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:33.800735 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] 10.222.0.10 "DELETE /v2.0/networks/4bad907f-fd8e-4849-9ded-63b7501aff2a HTTP/1.1" status: 204 len: 168 time: 0.6783731 Nov 11 14:33:33.803809 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38862) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:33.811598 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfa9a2e-70ac-46ce-a17e-f7cf2abe79c0 admin admin] Pushing event deleted for resources: {'Network': ['ID=4bad907f-fd8e-4849-9ded-63b7501aff2a,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:34.147962 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:34.342198 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b037cf4d-0426-4c96-9e8b-fb99b6d7899f no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:34.362780 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: b037cf4d-0426-4c96-9e8b-fb99b6d7899f {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:34.363196 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b037cf4d-0426-4c96-9e8b-fb99b6d7899f not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:34.363701 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:34.383147 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:34.383434 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 3c3a0bb9-1cbe-4f92-9fd5-e34a4a720005 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:34.383853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 46ec5320-e817-479c-a4c6-cd8e78c306de no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:34.392336 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Deleting port f448fe0f-023b-4bb2-b7ae-59c891f93f81 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:34.392728 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:34.402646 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 46ec5320-e817-479c-a4c6-cd8e78c306de {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:34.402996 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 46ec5320-e817-479c-a4c6-cd8e78c306de not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:34.473370 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] For port f448fe0f-023b-4bb2-b7ae-59c891f93f81, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=f448fe0f-023b-4bb2-b7ae-59c891f93f81,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:34.473756 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:34.486908 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Calling delete_port for f448fe0f-023b-4bb2-b7ae-59c891f93f81 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:34.656914 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ee9b9c-c7f3-4afb-89e8-9df36267ad2e req-c25c39cf-e2f7-4b01-969e-1026bea83784 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:34.658440 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-68ee9b9c-c7f3-4afb-89e8-9df36267ad2e req-c25c39cf-e2f7-4b01-969e-1026bea83784 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0576608 Nov 11 14:33:34.706446 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-68ee9b9c-c7f3-4afb-89e8-9df36267ad2e req-724411a8-0844-40f1-9876-9f548e2f5cbe tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422442 Nov 11 14:33:34.776375 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:34.793078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e5a4874-e164-453c-beb9-a8eeab19f0bd req-8d68f8e3-c7d5-4cac-8129-4a513a874b25 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:34.794567 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5e5a4874-e164-453c-beb9-a8eeab19f0bd req-8d68f8e3-c7d5-4cac-8129-4a513a874b25 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.1300080 Nov 11 14:33:34.814422 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Pushing event deleted for resources: {'Port': ['ID=f448fe0f-023b-4bb2-b7ae-59c891f93f81,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:34.904456 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-5e5a4874-e164-453c-beb9-a8eeab19f0bd req-32603f65-5b03-4a66-a842-fb380cef7ac9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0921354 Nov 11 14:33:35.045950 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:35.061454 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07981a3-afe4-4d76-ba16-9e3bb4c9b2cb req-a8ff7880-8466-4232-bb97-8074efb0e827 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:35.062957 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f07981a3-afe4-4d76-ba16-9e3bb4c9b2cb req-a8ff7880-8466-4232-bb97-8074efb0e827 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0701444 Nov 11 14:33:35.215248 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f07981a3-afe4-4d76-ba16-9e3bb4c9b2cb req-443d7eed-8d42-446d-9a23-8fc811ba18d6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1449919 Nov 11 14:33:35.232381 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-d938ee2d-2dc5-49b8-9b78-fe744ac447db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:35.233863 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-d938ee2d-2dc5-49b8-9b78-fe744ac447db service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1098 time: 0.1122780 Nov 11 14:33:35.409805 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-fdc69d3a-c567-436a-96a7-c0368ee67bbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:35.411267 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-fdc69d3a-c567-436a-96a7-c0368ee67bbd service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.1694002 Nov 11 14:33:35.418496 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Router 5083b643-9750-4836-bc71-1e5be9581dc8 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:33:35.755298 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-50c5e08b-898b-4086-a619-2539c44bae4e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 1000 time: 0.3356838 Nov 11 14:33:35.847250 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-b88f70de-31ba-4a5f-a638-e13f34a337c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:35.848720 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-b88f70de-31ba-4a5f-a638-e13f34a337c3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0846734 Nov 11 14:33:35.849779 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:33:35.857806 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-84541def-707b-45d8-bd54-8302d1678913 admin admin] 10.222.0.10 "PUT /v2.0/routers/5083b643-9750-4836-bc71-1e5be9581dc8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0496800 Nov 11 14:33:35.857916 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38876) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:35.859750 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Sync routers for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:33:35.870953 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:35.871874 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:35.899615 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-b1944314-3687-485b-9d94-a52102db267b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:35.901131 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-b1944314-3687-485b-9d94-a52102db267b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451899 Nov 11 14:33:35.976094 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks [] for router, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.004376 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-69bd0dc3-152c-472f-b978-bcdfa75c6a2e service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0958419 Nov 11 14:33:36.008873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:36.061664 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-896d096a-ee3c-4e19-b70b-a788c72525f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.102189 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c61a9dfc-0e8c-48a3-98d0-ef994b896154 req-0c0bfb9e-e4c8-42a5-96b2-9147ff46a57a service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911472 Nov 11 14:33:36.103681 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.192932 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25'}], 'enable_snat': True}, 'gw_port_id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:33:34Z', 'revision_number': 5, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port': {'id': '461ff056-a4bb-4f30-a34a-129bfb032513', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:06:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.25', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:25:10Z', 'updated_at': '2021-11-11T14:25:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:36.217530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3f2218-1b38-40ea-8efd-6f72e9ae104b req-8b3d5951-3576-46d4-ab8b-69be83c94338 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:36.218672 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Checking router: 5083b643-9750-4836-bc71-1e5be9581dc8 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:33:36.219175 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0a3f2218-1b38-40ea-8efd-6f72e9ae104b req-8b3d5951-3576-46d4-ab8b-69be83c94338 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.1521420 Nov 11 14:33:36.227274 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Routers {'5083b643-9750-4836-bc71-1e5be9581dc8'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:33:36.227904 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:33:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['5083b643-9750-4836-bc71-1e5be9581dc8'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:36.249570 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Deleting port 461ff056-a4bb-4f30-a34a-129bfb032513 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:36.249898 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.353610 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1cb1fc-b6f4-49ca-bbd3-ca4f407bb0c7 req-3d518785-4e9c-4755-9267-618ff749be24 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:36.356805 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0c1cb1fc-b6f4-49ca-bbd3-ca4f407bb0c7 req-3d518785-4e9c-4755-9267-618ff749be24 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0679200 Nov 11 14:33:36.362925 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] For port 461ff056-a4bb-4f30-a34a-129bfb032513, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=461ff056-a4bb-4f30-a34a-129bfb032513,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:36.363495 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.389348 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0a3f2218-1b38-40ea-8efd-6f72e9ae104b req-00f1acb7-9e34-4dbd-b3b0-4de8c1956d3e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1633525 Nov 11 14:33:36.390416 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Calling delete_port for 461ff056-a4bb-4f30-a34a-129bfb032513 owned by network:router_gateway {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:36.423605 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-0c1cb1fc-b6f4-49ca-bbd3-ca4f407bb0c7 req-c6679c11-dc92-499e-ac5b-f51d3e1a9a3e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0533400 Nov 11 14:33:36.452064 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] Set router 5083b643-9750-4836-bc71-1e5be9581dc8 gateway port host: None {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:33:36.505501 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:33:36Z', 'revision_number': 6, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:36.531749 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75d53e3b-bc8b-4800-97e4-5af5fc929af1 None None] The sync data for ids ['5083b643-9750-4836-bc71-1e5be9581dc8'] in dv-cinder-777031-9-iscsi is: [{'id': '5083b643-9750-4836-bc71-1e5be9581dc8', 'name': 'tempest-TestVolumeBootPattern-1999188518-router', 'tenant_id': '6f2d2f2a685f4d959d50143a77608757', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:25:09Z', 'updated_at': '2021-11-11T14:33:36Z', 'revision_number': 6, 'project_id': '6f2d2f2a685f4d959d50143a77608757', 'gw_port_host': None}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:33:36.648125 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.674317 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Pushing event deleted for resources: {'Port': ['ID=461ff056-a4bb-4f30-a34a-129bfb032513,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:36.734244 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.827895 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.829971 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.933871 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.934530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5083b643-9750-4836-bc71-1e5be9581dc8 {{(pid=102268) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:33:36.939989 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] Publish callbacks [] for router, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:36.941198 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-790195fe-c891-4cdb-b047-3485cabd3b41 admin admin] 10.222.0.10 "DELETE /v2.0/routers/5083b643-9750-4836-bc71-1e5be9581dc8 HTTP/1.1" status: 204 len: 168 time: 1.0828853 Nov 11 14:33:36.943737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 38886) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:36.989694 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Deleting subnet d25d7151-3252-4fbf-aa10-04f095fc4ab4 {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:33:36.992684 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.026368 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129741504'] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.105164 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.225401 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-125906296', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-129288619'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.250153 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d25d7151-3252-4fbf-aa10-04f095fc4ab4,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:37.253554 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.259179 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-669ce31e-dbbc-4c2f-8cd6-e0d4e2167b66 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/d25d7151-3252-4fbf-aa10-04f095fc4ab4 HTTP/1.1" status: 204 len: 168 time: 0.3123634 Nov 11 14:33:37.259810 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38888) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:37.265932 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f917b4-ee33-4d82-9dd0-0e513a678bdb None None] Network 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:33:37.332521 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.393206 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Deleting port 9531bbc6-e573-4973-9711-7996f7ff3dda {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:37.393537 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.448884 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] DHCP port deletion for 9dca3278-f4fb-4e25-85f0-9ca999fb7b9a request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:33:37.465389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] For port 9531bbc6-e573-4973-9711-7996f7ff3dda, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=9531bbc6-e573-4973-9711-7996f7ff3dda,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:37.465917 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.479832 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Calling delete_port for 9531bbc6-e573-4973-9711-7996f7ff3dda owned by network:dhcp {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:37.504387 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Deleting port 9531bbc6-e573-4973-9711-7996f7ff3dda {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:33:37.504758 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.536138 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2449bfff-995b-416d-a527-7f3860a58129 req-7906402a-033d-430e-871a-0b2152dbadb2 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:37.537830 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2449bfff-995b-416d-a527-7f3860a58129 req-7906402a-033d-430e-871a-0b2152dbadb2 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0667157 Nov 11 14:33:37.578394 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] For port 9531bbc6-e573-4973-9711-7996f7ff3dda, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=9531bbc6-e573-4973-9711-7996f7ff3dda,segment=NetworkSegment(580bddf4-f60f-47cb-bede-2acfa2f8a614),segment_id=580bddf4-f60f-47cb-bede-2acfa2f8a614)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:37.578839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.596699 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Calling delete_port for 9531bbc6-e573-4973-9711-7996f7ff3dda owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:33:37.601336 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2449bfff-995b-416d-a527-7f3860a58129 req-f6c79e8d-0574-496d-b58d-2bf235737147 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0569451 Nov 11 14:33:37.621214 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d020ac6-c9df-4b2a-ace3-d12f852db85e req-18de22e6-12e6-44c6-aa58-0c5beb84aa54 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:37.622749 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d020ac6-c9df-4b2a-ace3-d12f852db85e req-18de22e6-12e6-44c6-aa58-0c5beb84aa54 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0586841 Nov 11 14:33:37.623884 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.656244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Pushing event deleted for resources: {'Port': ['ID=9531bbc6-e573-4973-9711-7996f7ff3dda,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:37.666662 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] No DVR routers for this DVR port 9531bbc6-e573-4973-9711-7996f7ff3dda on host dv-cinder-777031-9-iscsi {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:37.677049 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.706053 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] Pushing event deleted for resources: {'Port': ['ID=9531bbc6-e573-4973-9711-7996f7ff3dda,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:37.709403 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6895e0d-eedf-4eb3-996a-9783c8ec8474 None None] No DVR routers for this DVR port 9531bbc6-e573-4973-9711-7996f7ff3dda on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:33:37.758922 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8d020ac6-c9df-4b2a-ace3-d12f852db85e req-f5dda64e-0a09-4f45-ab5e-16ce15a3949c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1270411 Nov 11 14:33:37.763452 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.783524 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9dca3278-f4fb-4e25-85f0-9ca999fb7b9a']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:37.793009 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '580bddf4-f60f-47cb-bede-2acfa2f8a614') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:37.793325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '580bddf4-f60f-47cb-bede-2acfa2f8a614') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:33:37.802331 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.815545 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.821185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Releasing vlan 315 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:33:37.821557 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:33:37.823151 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:33:37.950332 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.955650 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:37.958850 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] 10.222.0.10 "DELETE /v2.0/networks/9dca3278-f4fb-4e25-85f0-9ca999fb7b9a HTTP/1.1" status: 204 len: 168 time: 0.6982431 Nov 11 14:33:37.970806 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f10dd9-cfb0-4339-b56c-de3505d8aa23 admin admin] Pushing event deleted for resources: {'Network': ['ID=9dca3278-f4fb-4e25-85f0-9ca999fb7b9a,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:38.282143 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38898) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:38.323840 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-83af5e4e-4009-46ac-b872-02a74280c146 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=2d09ad6536ff49c4b4e43c8239742bc5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383258 Nov 11 14:33:38.324390 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38900) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:38.327885 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 9531bbc6-e573-4973-9711-7996f7ff3dda no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:38.348579 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 9531bbc6-e573-4973-9711-7996f7ff3dda {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:38.348920 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 9531bbc6-e573-4973-9711-7996f7ff3dda not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:38.349337 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device f448fe0f-023b-4bb2-b7ae-59c891f93f81 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:38.372569 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: f448fe0f-023b-4bb2-b7ae-59c891f93f81 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:38.372797 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:38.373056 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device f448fe0f-023b-4bb2-b7ae-59c891f93f81 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:38.373644 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 461ff056-a4bb-4f30-a34a-129bfb032513 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:38.395734 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:38.413046 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 461ff056-a4bb-4f30-a34a-129bfb032513 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:33:38.413390 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 461ff056-a4bb-4f30-a34a-129bfb032513 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:33:38.470639 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-8c26f0db-c000-475c-97c3-fb8d97450433 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:38.522103 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:38.524717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:38.525867 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/3acf3dcc-29e9-4219-9c33-ff5d63e00e1c HTTP/1.1" status: 204 len: 168 time: 0.1996229 Nov 11 14:33:38.534213 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d7265ec-f748-452b-8b96-f45749253b9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3acf3dcc-29e9-4219-9c33-ff5d63e00e1c,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:38.736262 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3977218-9517-4471-ab3a-f544bd16ebbd req-626d9bac-e237-4f37-9ffa-26b26f024c2d tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:38.739822 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d3977218-9517-4471-ab3a-f544bd16ebbd req-626d9bac-e237-4f37-9ffa-26b26f024c2d tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0661211 Nov 11 14:33:38.787632 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-d3977218-9517-4471-ab3a-f544bd16ebbd req-05338ab0-4d87-4c9b-b0ba-baba26740b7e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433681 Nov 11 14:33:39.136722 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38908) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:39.174966 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-623d91d8-75a0-44cf-9dce-76a2fa3c4375 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=6f2d2f2a685f4d959d50143a77608757&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0371392 Nov 11 14:33:39.177243 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 38910) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:33:39.224997 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:39.244937 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:39.358642 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:39.361320 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:39.362463 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/044927f8-76c9-4cbd-885c-8f840e0a5ef5 HTTP/1.1" status: 204 len: 168 time: 0.1843622 Nov 11 14:33:39.371384 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d484d8d8-fd7e-4dc9-a2a8-8a88a48f2aaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=044927f8-76c9-4cbd-885c-8f840e0a5ef5,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:39.695858 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:39.908023 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bc6bb5-5b28-42dd-9038-239c1b551d2c req-0e8196b8-c13a-4dc0-86fb-ac55ee5a1633 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:39.909745 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-10bc6bb5-5b28-42dd-9038-239c1b551d2c req-0e8196b8-c13a-4dc0-86fb-ac55ee5a1633 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0518155 Nov 11 14:33:39.961674 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-10bc6bb5-5b28-42dd-9038-239c1b551d2c req-77c1a853-520a-4dd1-b325-d73f54015c45 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456917 Nov 11 14:33:40.784902 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:41.078456 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09c23e17-0229-45aa-bad6-b0046779f6f0 req-37609f0f-13cc-4963-91d4-895a799ab461 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:41.080028 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-09c23e17-0229-45aa-bad6-b0046779f6f0 req-37609f0f-13cc-4963-91d4-895a799ab461 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0478494 Nov 11 14:33:41.128793 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-09c23e17-0229-45aa-bad6-b0046779f6f0 req-d01cfce0-7660-480c-9a4a-f7db73b95388 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427086 Nov 11 14:33:41.712173 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:42.186732 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:42.238930 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7d4f09c-f94e-41e5-9e51-8e23ad5b16f7 req-53f858ea-d28b-474b-a30f-aec42757cc02 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:42.240403 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a7d4f09c-f94e-41e5-9e51-8e23ad5b16f7 req-53f858ea-d28b-474b-a30f-aec42757cc02 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0471761 Nov 11 14:33:42.299031 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a7d4f09c-f94e-41e5-9e51-8e23ad5b16f7 req-d3a2aa54-d64b-4060-a0a3-b68fa3da8c1b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518377 Nov 11 14:33:43.418873 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1365679-79c8-49ff-83ea-77a0c86cb483 req-b62a66c4-447a-4771-9695-c0cf064a001a tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:43.420334 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f1365679-79c8-49ff-83ea-77a0c86cb483 req-b62a66c4-447a-4771-9695-c0cf064a001a tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0548527 Nov 11 14:33:43.467891 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f1365679-79c8-49ff-83ea-77a0c86cb483 req-8f260142-ea3e-457c-9f83-1ac68556f3e6 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417852 Nov 11 14:33:44.580128 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b09aee-0424-4589-85e0-d9c33b2025c9 req-44f0853a-c192-4c3f-92b0-ca30e58beb44 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:44.581590 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b2b09aee-0424-4589-85e0-d9c33b2025c9 req-44f0853a-c192-4c3f-92b0-ca30e58beb44 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0480945 Nov 11 14:33:44.629532 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b2b09aee-0424-4589-85e0-d9c33b2025c9 req-a839165c-5474-4eda-85ae-49bbe331279e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421515 Nov 11 14:33:44.920414 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789967ae-df80-4549-b08a-b098d217d508 req-5299a65b-e7cf-48b6-8351-e343b6668cb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:44.921846 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-5299a65b-e7cf-48b6-8351-e343b6668cb1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.0392938 Nov 11 14:33:45.015131 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789967ae-df80-4549-b08a-b098d217d508 req-b72b6629-73e6-4e91-bad7-c13f85a20f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:45.016688 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-b72b6629-73e6-4e91-bad7-c13f85a20f4e service neutron] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 908 time: 0.0871015 Nov 11 14:33:45.080358 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-865aabd2-088f-4426-90c3-15b89505ecbf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 1002 time: 0.0570579 Nov 11 14:33:45.132382 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789967ae-df80-4549-b08a-b098d217d508 req-b6be715c-4264-4a2d-b7a9-dcf2410479f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:45.133848 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-b6be715c-4264-4a2d-b7a9-dcf2410479f6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0473340 Nov 11 14:33:45.177125 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789967ae-df80-4549-b08a-b098d217d508 req-e4116fde-d8c8-4a08-b1cc-a4f21aba8660 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:45.178453 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-e4116fde-d8c8-4a08-b1cc-a4f21aba8660 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382767 Nov 11 14:33:45.263855 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-ea790b75-6ba4-468b-bf45-2df88453d90d service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786452 Nov 11 14:33:45.354949 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-789967ae-df80-4549-b08a-b098d217d508 req-6d9513fa-efd5-4ac3-a1a9-919b01ceef14 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834413 Nov 11 14:33:45.741692 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c86948b-0887-49f3-8c13-b73cc9fe14c6 req-5171e513-f6aa-4901-9682-1f94a43195d7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:45.743144 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5c86948b-0887-49f3-8c13-b73cc9fe14c6 req-5171e513-f6aa-4901-9682-1f94a43195d7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0476549 Nov 11 14:33:45.791631 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-5c86948b-0887-49f3-8c13-b73cc9fe14c6 req-da44c82e-43b1-4cf1-acc9-27fc0056b1e1 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421448 Nov 11 14:33:46.905567 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b93f9865-27b8-486c-b2c8-ff73ad9a496c req-3c799bde-d44f-4d18-8239-e5df3dcd4cc5 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:46.907067 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b93f9865-27b8-486c-b2c8-ff73ad9a496c req-3c799bde-d44f-4d18-8239-e5df3dcd4cc5 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0491066 Nov 11 14:33:46.955124 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b93f9865-27b8-486c-b2c8-ff73ad9a496c req-296ae6db-ff14-419b-8f79-3a37e066f789 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421441 Nov 11 14:33:47.793608 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-06b55740-3d02-4180-ab46-5d3881cf1a7d service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0432384 Nov 11 14:33:47.852363 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-e7c328be-83ee-47ac-b2eb-1c832ad365a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:47.853804 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-e7c328be-83ee-47ac-b2eb-1c832ad365a1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.0391121 Nov 11 14:33:47.959494 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-14198704-2806-4f82-a6a3-cde7ee847a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:47.960928 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-14198704-2806-4f82-a6a3-cde7ee847a90 service neutron] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 908 time: 0.0868499 Nov 11 14:33:48.029453 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-0e66fdf1-cba0-450e-bd1d-43ce6312a0b0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 1002 time: 0.0604770 Nov 11 14:33:48.081665 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-740e3cf7-88f5-498f-9a42-3b1d5a188d76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:48.083094 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-740e3cf7-88f5-498f-9a42-3b1d5a188d76 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0464113 Nov 11 14:33:48.088561 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4b31aa-9456-49cd-a5bd-32b8d2e94119 req-50fbc580-d232-4890-b88f-f21c72081e85 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:48.090058 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9a4b31aa-9456-49cd-a5bd-32b8d2e94119 req-50fbc580-d232-4890-b88f-f21c72081e85 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0563583 Nov 11 14:33:48.140087 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-3e37444f-db8a-42eb-a9c9-87bbf449a437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:48.141498 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-3e37444f-db8a-42eb-a9c9-87bbf449a437 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451705 Nov 11 14:33:48.146926 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-9a4b31aa-9456-49cd-a5bd-32b8d2e94119 req-80b083bf-721d-42a8-9e83-e9286f640707 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509810 Nov 11 14:33:48.153503 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-abb7f8f9-799d-44e1-93f9-f985516959cf service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:33:48.154440 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-abb7f8f9-799d-44e1-93f9-f985516959cf service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050902 Nov 11 14:33:48.220586 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-49fd9f4f-2169-4fe3-b0bf-c80ea0325a9c req-a53b5122-c56e-4324-815a-97fda7b8c1a5 service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:33:48.221542 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-49fd9f4f-2169-4fe3-b0bf-c80ea0325a9c req-a53b5122-c56e-4324-815a-97fda7b8c1a5 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0067332 Nov 11 14:33:48.252689 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-aab99e1c-8755-40db-80d1-eb4a7ec5be10 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904343 Nov 11 14:33:48.347538 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b826384f-2b42-4f0a-81b2-ce5bdfa6a4ef req-6afb516c-4ae5-486d-b49e-f3fdfff69111 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859663 Nov 11 14:33:48.528023 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c92dfe5-fbf3-4f2c-9f33-254a0127ca07 req-23f6f20d-5a99-4b19-9aab-bb7584d0b8e7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:48.529460 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6c92dfe5-fbf3-4f2c-9f33-254a0127ca07 req-23f6f20d-5a99-4b19-9aab-bb7584d0b8e7 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0689917 Nov 11 14:33:48.559249 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-bf55daf4-72f5-4514-86b7-eb0c2514960d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0633082 Nov 11 14:33:48.586641 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6c92dfe5-fbf3-4f2c-9f33-254a0127ca07 req-479cbfaf-8f10-438c-bff1-ab171d51ddf1 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507643 Nov 11 14:33:49.479293 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:33:49.555199 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:49.577769 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:33:49.580005 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-755ea964-946c-465e-948d-d4c1d639accf" -d '{"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-unplugged", "status": "completed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:33:49.592768 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:49.614329 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 11 Nov 2021 14:33:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5adf4d8f-5a4e-4e75-b0f2-f2dd416b3e25 x-openstack-request-id: req-5adf4d8f-5a4e-4e75-b0f2-f2dd416b3e25 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:33:49.614550 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-unplugged", "status": "failed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "code": 422}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:33:49.614953 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-5adf4d8f-5a4e-4e75-b0f2-f2dd416b3e25 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:33:49.615142 dv-cinder-777031-9-iscsi neutron-server[102269]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'code': 422} returned with failed status Nov 11 14:33:49.701464 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:49.701917 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e5e8dd-8b67-4503-aed9-b3e6056cbdcb req-bf6e90e3-6c2f-498c-abbb-088d6e62f8f9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:49.703397 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-52e5e8dd-8b67-4503-aed9-b3e6056cbdcb req-bf6e90e3-6c2f-498c-abbb-088d6e62f8f9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0515783 Nov 11 14:33:49.752723 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=6']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:33:49.754273 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-52e5e8dd-8b67-4503-aed9-b3e6056cbdcb req-73ef5a7f-91fe-4bd2-9435-571c0e2a5552 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448875 Nov 11 14:33:50.885499 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-c0fef506-b14a-4d6d-b0a2-82c43b8a4cc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:50.886962 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-c0fef506-b14a-4d6d-b0a2-82c43b8a4cc0 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74&tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835 HTTP/1.1" status: 200 len: 1097 time: 0.0673277 Nov 11 14:33:50.896421 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09b6e52-155c-4d33-9720-60d398da38f4 req-30a41f49-6b62-4370-8d4a-499cd599fe47 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:50.897773 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c09b6e52-155c-4d33-9720-60d398da38f4 req-30a41f49-6b62-4370-8d4a-499cd599fe47 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0703483 Nov 11 14:33:50.977411 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c09b6e52-155c-4d33-9720-60d398da38f4 req-6a16cb70-94a2-498d-af91-d5628be87b6e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0727942 Nov 11 14:33:50.980106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-731b7292-4e41-4d64-b744-06070123f962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:50.982012 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-731b7292-4e41-4d64-b744-06070123f962 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1097 time: 0.0712531 Nov 11 14:33:51.071334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-6234cadb-7874-471e-acd2-a7028305df8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:51.073783 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-6234cadb-7874-471e-acd2-a7028305df8f service neutron] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 908 time: 0.0856311 Nov 11 14:33:51.144301 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-bb249878-db91-441c-835c-32e4a7812470 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 1000 time: 0.0625598 Nov 11 14:33:51.193065 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-0148ffb4-bb83-498d-a2b3-0bf233ceb3f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:51.194486 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-0148ffb4-bb83-498d-a2b3-0bf233ceb3f4 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0433598 Nov 11 14:33:51.237630 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-a89dfc45-6416-4e29-aee1-c244c27532c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:51.239014 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-a89dfc45-6416-4e29-aee1-c244c27532c7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0380776 Nov 11 14:33:51.328220 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-a6e1b029-d403-4a6d-bd32-1db5b344cd21 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821185 Nov 11 14:33:51.415901 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1380b48e-5ae1-44f1-86b9-a6f1d15b0540 req-ed7776e1-0f38-4882-b924-4e6f1e7f003b service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811977 Nov 11 14:33:52.091356 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080bf602-b39a-4078-ad53-935ccefeb00d req-6371d832-6ec9-4cc9-8c8a-7623b37de8d4 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:52.092803 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-080bf602-b39a-4078-ad53-935ccefeb00d req-6371d832-6ec9-4cc9-8c8a-7623b37de8d4 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0470986 Nov 11 14:33:52.141670 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-080bf602-b39a-4078-ad53-935ccefeb00d req-bb2019fc-82da-42de-a3fc-c3e20b28b338 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431685 Nov 11 14:33:53.257016 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b1a86f5-f681-4e3c-89a1-f6b7ab9518af req-4c763720-5688-40a9-81a8-ecb1ad67a488 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:53.258474 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9b1a86f5-f681-4e3c-89a1-f6b7ab9518af req-4c763720-5688-40a9-81a8-ecb1ad67a488 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0521193 Nov 11 14:33:53.306398 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9b1a86f5-f681-4e3c-89a1-f6b7ab9518af req-fbcc17b4-a664-44fe-af55-fee1d9a4afb3 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409636 Nov 11 14:33:54.344481 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:33:54.436199 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b166663e-c59a-456d-afe8-39931160de3f req-c7f2dabb-30a9-4416-b6d8-0d3984d805ef tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:54.437665 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b166663e-c59a-456d-afe8-39931160de3f req-c7f2dabb-30a9-4416-b6d8-0d3984d805ef tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0581977 Nov 11 14:33:54.489064 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b166663e-c59a-456d-afe8-39931160de3f req-e6d3cdc4-71b5-44a0-ac9d-39e305910d77 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455260 Nov 11 14:33:55.600975 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba740ed-837d-42b1-ab98-7e1c4b833676 req-2f78c45b-ccab-423f-927d-5c81bec3b2d4 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:55.602417 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fba740ed-837d-42b1-ab98-7e1c4b833676 req-2f78c45b-ccab-423f-927d-5c81bec3b2d4 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0474844 Nov 11 14:33:55.650122 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fba740ed-837d-42b1-ab98-7e1c4b833676 req-a9f16fd0-a143-41c3-b935-0bf50f4f2bbf tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411773 Nov 11 14:33:56.761046 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71135d74-c098-46bd-8291-ca43eaa5f8bc req-a650e5d0-c708-41db-bfe0-59ae1eac7e7b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:56.762497 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-71135d74-c098-46bd-8291-ca43eaa5f8bc req-a650e5d0-c708-41db-bfe0-59ae1eac7e7b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0473289 Nov 11 14:33:56.810199 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-71135d74-c098-46bd-8291-ca43eaa5f8bc req-ba4a8182-6e7c-4c89-bf71-9bf486493770 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414245 Nov 11 14:33:57.922325 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a0d8bd3-fbd2-416d-94c1-5dfdba5501b6 req-f79da5cc-56f6-40ad-9aa7-266d0d80cdc8 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:57.923802 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8a0d8bd3-fbd2-416d-94c1-5dfdba5501b6 req-f79da5cc-56f6-40ad-9aa7-266d0d80cdc8 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0478821 Nov 11 14:33:57.974545 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8a0d8bd3-fbd2-416d-94c1-5dfdba5501b6 req-4544fb31-f01f-4a70-9b54-2a550d86e084 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448520 Nov 11 14:33:59.092123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ec37fb-a38c-4544-a661-1dd7fb118f97 req-2f71dbf5-303b-44a2-97c6-6191b3b27bc0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:33:59.093663 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b8ec37fb-a38c-4544-a661-1dd7fb118f97 req-2f71dbf5-303b-44a2-97c6-6191b3b27bc0 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 944 time: 0.0545115 Nov 11 14:33:59.144372 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b8ec37fb-a38c-4544-a661-1dd7fb118f97 req-633a390f-47a7-4c47-b0a7-97e11d10967c tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446396 Nov 11 14:33:59.520203 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:33:59.611015 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:59.621637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '39852042-e8c3-45ba-9635-1bcf0760856e', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'port_id': '39852042-e8c3-45ba-9635-1bcf0760856e', 'mac_address': 'fa:16:3e:87:8f:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 309, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:33:59.661010 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:59.673753 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39852042-e8c3-45ba-9635-1bcf0760856e {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:33:59.693032 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:33:59.769627 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:33:59.816948 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=7']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:34:00.014447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['39852042-e8c3-45ba-9635-1bcf0760856e'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:34:00.256494 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73901a17-6bff-4c41-904d-d2613f47394d req-80435314-b324-440b-8ac1-57661923d06f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:00.257943 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-73901a17-6bff-4c41-904d-d2613f47394d req-80435314-b324-440b-8ac1-57661923d06f tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 945 time: 0.0492599 Nov 11 14:34:00.306346 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-73901a17-6bff-4c41-904d-d2613f47394d req-862a4ac5-d1be-4445-8164-507f96f84af1 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420043 Nov 11 14:34:01.421040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b7e197-6691-4fa3-9eb0-40e03a5b786e req-c36dff19-e1a7-4ea5-bc71-75ba1c97ed28 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:01.422385 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-22b7e197-6691-4fa3-9eb0-40e03a5b786e req-c36dff19-e1a7-4ea5-bc71-75ba1c97ed28 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 945 time: 0.0514455 Nov 11 14:34:01.470753 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-22b7e197-6691-4fa3-9eb0-40e03a5b786e req-540535b1-f572-4c6d-97a7-0ee1c3026850 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425460 Nov 11 14:34:01.589613 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:34:01.635950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 39852042-e8c3-45ba-9635-1bcf0760856e triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:34:01.636310 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:01.712281 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:01.733838 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:34:01.736044 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91acdcf8-51a1-4892-a756-18d673e1a660" -d '{"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-plugged", "status": "completed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:34:01.748741 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:34:01.772838 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:34:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05b9b5e6-3fa5-45d5-bd9e-72656eec620d x-openstack-request-id: req-05b9b5e6-3fa5-45d5-bd9e-72656eec620d {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:34:01.773128 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-plugged", "status": "completed", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:34:01.773381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-05b9b5e6-3fa5-45d5-bd9e-72656eec620d {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:34:01.773771 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'code': 200} Nov 11 14:34:01.818522 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:01.864393 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=8']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:34:02.167637 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b63a78-7cac-49d9-846c-173deff98a5f req-592f1521-1438-4d4a-94f1-eb182f27ae0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:02.169703 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-38b63a78-7cac-49d9-846c-173deff98a5f req-592f1521-1438-4d4a-94f1-eb182f27ae0d service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.1741946 Nov 11 14:34:02.215221 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-38b63a78-7cac-49d9-846c-173deff98a5f req-4ed01af2-f4dc-4351-a02c-ff228e92241d service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0364490 Nov 11 14:34:02.580759 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933983a5-c6ac-4219-be1f-efc3030deeea req-ff03c1db-c93e-433e-aefd-5b959a761984 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:02.582201 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-933983a5-c6ac-4219-be1f-efc3030deeea req-ff03c1db-c93e-433e-aefd-5b959a761984 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0469525 Nov 11 14:34:02.629693 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-933983a5-c6ac-4219-be1f-efc3030deeea req-43ae147c-7ea0-4755-bcc5-b9c913ab1c5d tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417509 Nov 11 14:34:03.748925 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca7d57d-c913-460f-b4e3-d0947b690799 req-15508640-ea33-4c8f-9c22-db462318a88c tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:03.750388 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cca7d57d-c913-460f-b4e3-d0947b690799 req-15508640-ea33-4c8f-9c22-db462318a88c tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0514407 Nov 11 14:34:03.798710 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cca7d57d-c913-460f-b4e3-d0947b690799 req-68278883-744a-47c2-a6de-2465c2c2cc62 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423756 Nov 11 14:34:06.026212 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-bd822ca3-bd34-4988-853c-e2af8cea5148 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:08.472680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0490b89c-5715-4ba5-bf0a-e001923a2fad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:09.683488 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:10.766969 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:11.706642 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:12.140734 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:12.189500 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3125a3c4-3ce6-4bdd-a2ae-442da1177edd req-45a42e89-eba7-4485-9c74-4598d0cd2332 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:12.190956 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3125a3c4-3ce6-4bdd-a2ae-442da1177edd req-45a42e89-eba7-4485-9c74-4598d0cd2332 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0519609 Nov 11 14:34:12.237008 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-3125a3c4-3ce6-4bdd-a2ae-442da1177edd req-a72289de-4648-4645-871a-dbcbe278ac1e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401695 Nov 11 14:34:13.350730 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1894a9bf-5cc6-429b-b9ee-e03e83b3769e req-5fcb7e7a-9417-4cd8-8f7c-eeafd2952b43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:13.352185 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1894a9bf-5cc6-429b-b9ee-e03e83b3769e req-5fcb7e7a-9417-4cd8-8f7c-eeafd2952b43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0475802 Nov 11 14:34:13.397810 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1894a9bf-5cc6-429b-b9ee-e03e83b3769e req-fee81e13-5d14-445a-b640-429901cdc9df tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393455 Nov 11 14:34:14.510203 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0064b1ea-774d-4608-808b-9292f5b7b6d6 req-7bed7ec6-5b67-42af-8f88-cbac08f14665 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:14.511657 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0064b1ea-774d-4608-808b-9292f5b7b6d6 req-7bed7ec6-5b67-42af-8f88-cbac08f14665 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0479720 Nov 11 14:34:14.557194 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0064b1ea-774d-4608-808b-9292f5b7b6d6 req-5b300a31-0342-4448-855e-f58475468fc5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388918 Nov 11 14:34:15.669861 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c32e2d-7bc6-4bc3-8631-122a6ea01a72 req-c0fe3904-289c-4c39-b42f-9a3ed80d08d8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:15.671319 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f6c32e2d-7bc6-4bc3-8631-122a6ea01a72 req-c0fe3904-289c-4c39-b42f-9a3ed80d08d8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0477464 Nov 11 14:34:15.720842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f6c32e2d-7bc6-4bc3-8631-122a6ea01a72 req-d98b8846-c325-47f6-aa47-d9e348c1b767 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436599 Nov 11 14:34:16.831426 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed1dfd8-9597-48ec-af35-3ecbe3447f25 req-553f3184-f779-4dfa-aeaa-2d3e97cdede3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:16.832876 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0ed1dfd8-9597-48ec-af35-3ecbe3447f25 req-553f3184-f779-4dfa-aeaa-2d3e97cdede3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0469449 Nov 11 14:34:16.882105 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0ed1dfd8-9597-48ec-af35-3ecbe3447f25 req-0b7b8878-5955-48f6-ad31-94839cbe731a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434585 Nov 11 14:34:17.995054 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ead676b-c7a5-47e8-b719-6b940092d9f4 req-a3607c6a-36be-49c5-9346-c2215e80cfe3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:17.996526 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9ead676b-c7a5-47e8-b719-6b940092d9f4 req-a3607c6a-36be-49c5-9346-c2215e80cfe3 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0479314 Nov 11 14:34:18.041553 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9ead676b-c7a5-47e8-b719-6b940092d9f4 req-c9cf6287-7ec3-4955-a0ef-c098e303444a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393236 Nov 11 14:34:19.154284 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacb3d22-9cf9-40ab-a934-5ad1cecc2023 req-06b00f93-85d0-436f-8ecc-1ed2b11684f7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:19.155754 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cacb3d22-9cf9-40ab-a934-5ad1cecc2023 req-06b00f93-85d0-436f-8ecc-1ed2b11684f7 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0483856 Nov 11 14:34:19.201980 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-cacb3d22-9cf9-40ab-a934-5ad1cecc2023 req-c15daf67-8042-4b91-9ee7-75a340b4323f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404451 Nov 11 14:34:20.312321 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de127314-3e8a-4f24-b671-90ae0eee803e req-20fe670d-729b-4868-8bfe-c2d579a50568 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:20.313758 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-de127314-3e8a-4f24-b671-90ae0eee803e req-20fe670d-729b-4868-8bfe-c2d579a50568 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0473924 Nov 11 14:34:20.360132 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-de127314-3e8a-4f24-b671-90ae0eee803e req-f5143c42-d156-4b77-beeb-997cc5563277 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407214 Nov 11 14:34:21.472246 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d7742c-e2ff-4945-a66d-97ce184dc3ea req-d78213ca-f82a-4b08-b2dd-ef1a0cf690d8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:21.473703 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f4d7742c-e2ff-4945-a66d-97ce184dc3ea req-d78213ca-f82a-4b08-b2dd-ef1a0cf690d8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0481274 Nov 11 14:34:21.520143 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f4d7742c-e2ff-4945-a66d-97ce184dc3ea req-10c2ff78-f74e-40c7-85d5-7099655a3983 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406075 Nov 11 14:34:22.637207 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bc5e9b-e2e1-4d60-ae89-3defc3916ba4 req-37924c8b-f51c-4215-96a2-072657da4db1 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:22.638925 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b1bc5e9b-e2e1-4d60-ae89-3defc3916ba4 req-37924c8b-f51c-4215-96a2-072657da4db1 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0519869 Nov 11 14:34:22.686288 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b1bc5e9b-e2e1-4d60-ae89-3defc3916ba4 req-43ee8355-64f4-4103-8bb4-976b1027e02d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414207 Nov 11 14:34:23.802242 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bb299e0-bce4-492f-a1d1-547e5e49ae3c req-a8691b01-3270-48b8-8e31-ca2c6bc00ebf tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:23.803705 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2bb299e0-bce4-492f-a1d1-547e5e49ae3c req-a8691b01-3270-48b8-8e31-ca2c6bc00ebf tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0533051 Nov 11 14:34:23.849448 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-2bb299e0-bce4-492f-a1d1-547e5e49ae3c req-7390e82f-7bec-45b9-877b-8c94e99a2992 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399644 Nov 11 14:34:24.222961 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498176c6-c9eb-4528-92be-05d6427934fa req-a3b5595f-9243-48fd-8526-c2b923b9495b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:24.224442 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-498176c6-c9eb-4528-92be-05d6427934fa req-a3b5595f-9243-48fd-8526-c2b923b9495b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0488198 Nov 11 14:34:24.275741 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-498176c6-c9eb-4528-92be-05d6427934fa req-c7aea664-c0f7-4bd9-8879-c6615182e594 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454216 Nov 11 14:34:24.364127 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-d74c3b5f-2291-48e8-8e42-b33b0d5d9c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:24.365537 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-d74c3b5f-2291-48e8-8e42-b33b0d5d9c0b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1098 time: 0.0385361 Nov 11 14:34:24.458564 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-1c14803e-2f4d-46c1-b08d-dd7c280b0070 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:24.460035 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-1c14803e-2f4d-46c1-b08d-dd7c280b0070 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.0851133 Nov 11 14:34:24.531207 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-1bf1829e-1bef-467a-9d8d-e660845a4e73 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 1000 time: 0.0623538 Nov 11 14:34:24.578192 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-d629ea12-acb4-428b-8a0d-0b27c39365da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:24.579578 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-d629ea12-acb4-428b-8a0d-0b27c39365da service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0410137 Nov 11 14:34:24.626225 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-039fac9f-0c7a-4bc3-b769-dea850f1c95b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:24.627653 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-039fac9f-0c7a-4bc3-b769-dea850f1c95b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407312 Nov 11 14:34:24.715008 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-451665f4-8a63-4870-871a-4893f53366a0 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786247 Nov 11 14:34:24.804847 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-65a4c302-1f64-4b4d-95b4-dfbde473c0a8 req-e206c5fc-29ca-4b01-b6ed-c827c4746e2d service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824826 Nov 11 14:34:25.391541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be820fbe-8774-4c6e-9e6c-afd383a14b15 req-6c1ad6be-f4c7-4387-89c2-ec8b7ff1e5e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:25.392900 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-be820fbe-8774-4c6e-9e6c-afd383a14b15 req-6c1ad6be-f4c7-4387-89c2-ec8b7ff1e5e8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0487831 Nov 11 14:34:25.439536 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-be820fbe-8774-4c6e-9e6c-afd383a14b15 req-50992803-250c-4d3c-87cf-2a219c7d3234 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408173 Nov 11 14:34:26.560919 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d0a9fd3-2b55-4a17-bfe0-72f63d76874f req-6bd71442-9409-42cb-b2c6-d2c8f463846e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:26.562344 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6d0a9fd3-2b55-4a17-bfe0-72f63d76874f req-6bd71442-9409-42cb-b2c6-d2c8f463846e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0468321 Nov 11 14:34:26.611014 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6d0a9fd3-2b55-4a17-bfe0-72f63d76874f req-326bdd77-bc1d-42b0-843d-eb8c6021704a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429246 Nov 11 14:34:31.344664 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:34:36.034750 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a249841f-4460-4001-932d-402fc4596d01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:38.466743 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3d8c7a28-39f1-4753-b0d4-6cbc5bc05acc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:39.671918 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:40.780760 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:41.732504 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:42.143467 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:34:49.772790 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-02861c51-351a-400c-91fc-5ae876a49d7e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0395689 Nov 11 14:34:49.835276 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-d8faa4fa-6fff-403d-ae2a-87f3460aa36e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:49.836732 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-d8faa4fa-6fff-403d-ae2a-87f3460aa36e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 1098 time: 0.0420938 Nov 11 14:34:49.938115 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-2e72399d-1785-4aa4-81aa-ee6c7a52bfb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:49.939595 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-2e72399d-1785-4aa4-81aa-ee6c7a52bfb4 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.0830035 Nov 11 14:34:50.006343 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-1fcae884-1b79-4cbd-97cf-72d891936a32 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 200 len: 1000 time: 0.0595183 Nov 11 14:34:50.054518 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-95ae4428-8ab7-4cdd-86fb-22bbeb251223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:50.055839 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-95ae4428-8ab7-4cdd-86fb-22bbeb251223 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0419371 Nov 11 14:34:50.099089 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-ae7eb28d-8d3f-47cb-953c-622438e93dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:50.100546 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-ae7eb28d-8d3f-47cb-953c-622438e93dfb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0375028 Nov 11 14:34:50.195300 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-bb8eb703-d727-4f6c-a6de-7a48b7e3cf2c service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875096 Nov 11 14:34:50.282030 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7259b70d-04e6-4312-8b0a-09ad5634b45a req-7e22566f-ec76-497f-9a31-ca4852e52c7b service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791080 Nov 11 14:34:59.196411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7caefb-50fd-495c-9e62-0c329e8a1254 req-43f1a1a9-2f52-4c84-8b25-3ff07b4b68e6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:34:59.197859 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ca7caefb-50fd-495c-9e62-0c329e8a1254 req-43f1a1a9-2f52-4c84-8b25-3ff07b4b68e6 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0542417 Nov 11 14:34:59.242964 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-ca7caefb-50fd-495c-9e62-0c329e8a1254 req-00d5df09-4839-4fed-9a83-13a72df9aabc tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388079 Nov 11 14:35:00.356552 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe71cb62-bbf7-4343-8dde-2a8bf5c4f9c2 req-e2e09ea0-be4a-4c68-a3b4-098e321f32f8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:00.357994 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe71cb62-bbf7-4343-8dde-2a8bf5c4f9c2 req-e2e09ea0-be4a-4c68-a3b4-098e321f32f8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0474453 Nov 11 14:35:00.403824 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-fe71cb62-bbf7-4343-8dde-2a8bf5c4f9c2 req-a56a1622-5cb8-4073-80ab-f86ff3ba5835 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394342 Nov 11 14:35:00.968043 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-51c69c43-b32d-404d-b12c-0cc8b69fe8d5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:00.969465 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-51c69c43-b32d-404d-b12c-0cc8b69fe8d5 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0464783 Nov 11 14:35:01.063894 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Deleting port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:01.064231 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:01.156971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] For port 0b721e62-0210-4b18-9adf-83c6bd5b25b8, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=0b721e62-0210-4b18-9adf-83c6bd5b25b8,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:01.157328 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:01.592228 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fde3a4c-79de-4c4e-98f9-dae2480973ab req-e8500c3d-2d2e-4448-9427-602f8c8c3650 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:01.594227 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fde3a4c-79de-4c4e-98f9-dae2480973ab req-e8500c3d-2d2e-4448-9427-602f8c8c3650 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 945 time: 0.0984669 Nov 11 14:35:01.620095 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:01.620449 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:01.620760 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Floating IP 75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6 disassociated. External IP: 172.27.1.55, port: 0b721e62-0210-4b18-9adf-83c6bd5b25b8. Nov 11 14:35:01.621094 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Calling delete_port for 0b721e62-0210-4b18-9adf-83c6bd5b25b8 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:01.688217 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9fde3a4c-79de-4c4e-98f9-dae2480973ab req-10406587-8973-4cba-9247-46b0bd4dd5bc tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=3c180698-7398-4106-96b0-85ffd84015a7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0875387 Nov 11 14:35:01.817447 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:01.846141 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'Port': ['ID=0b721e62-0210-4b18-9adf-83c6bd5b25b8,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:01.857185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.857540 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.857886 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.858225 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.858561 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.858895 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.859227 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.859717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.859891 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.860216 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.860541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.860863 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:01.971969 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:35:02.075078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:35:02.085154 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:35:02.094843 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:02.095468 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:34:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:02.112215 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] No DVR routers for this DVR port 0b721e62-0210-4b18-9adf-83c6bd5b25b8 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:02.114878 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:02.118433 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-13ea2efc-e1b7-4c16-9eb5-9212a210d2dd req-73f8f0ae-56a4-4cc9-a214-5a39d98eaa94 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "DELETE /v2.0/ports/0b721e62-0210-4b18-9adf-83c6bd5b25b8 HTTP/1.1" status: 204 len: 173 time: 1.1426580 Nov 11 14:35:02.118819 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'name': 'network-vif-deleted', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:02.121842 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ff7ee54-f4e8-4c15-b739-c89aace45a9c" -d '{"events": [{"server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "name": "network-vif-deleted", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:02.208317 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:02.302274 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6ba8926-3394-4bb7-8604-fb294a4d5118 x-openstack-request-id: req-a6ba8926-3394-4bb7-8604-fb294a4d5118 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:02.302570 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e613769-f3b8-47eb-9adf-ec9ea541648c", "name": "network-vif-deleted", "tag": "0b721e62-0210-4b18-9adf-83c6bd5b25b8", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:02.302823 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a6ba8926-3394-4bb7-8604-fb294a4d5118 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:02.303225 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e613769-f3b8-47eb-9adf-ec9ea541648c', 'name': 'network-vif-deleted', 'tag': '0b721e62-0210-4b18-9adf-83c6bd5b25b8', 'status': 'completed', 'code': 200} Nov 11 14:35:02.504064 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:02.528878 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:35:02.537362 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:02.537940 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:34:38Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:02.638353 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:02.795586 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-afcb9c79-51ef-4434-8e73-778d9b53bd1b req-327545fe-08ff-4980-ad0a-0fd9c208b12e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9e613769-f3b8-47eb-9adf-ec9ea541648c HTTP/1.1" status: 200 len: 210 time: 0.0286410 Nov 11 14:35:02.833622 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:02.859862 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44b0d5c-61d2-469a-acb6-d0a3de6d505d None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:35:03.081101 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f800dc4-7f69-403b-8010-92e9aac5e2f1 None None] New status for floating IP 75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6: DOWN {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:35:03.858130 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0b721e62-0210-4b18-9adf-83c6bd5b25b8 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:03.878754 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 0b721e62-0210-4b18-9adf-83c6bd5b25b8 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:03.879116 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 0b721e62-0210-4b18-9adf-83c6bd5b25b8 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:03.958253 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39060) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:04.011183 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.034679 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.160177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.162852 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.164009 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "DELETE /v2.0/security-groups/3c180698-7398-4106-96b0-85ffd84015a7 HTTP/1.1" status: 204 len: 168 time: 0.2047784 Nov 11 14:35:04.166842 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39062) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:04.173123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c180698-7398-4106-96b0-85ffd84015a7,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:04.180021 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.api.v2.resource [None req-5c35beff-5578-4695-8a6f-bb7aebda76a4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] show failed (client error): The resource could not be found. Nov 11 14:35:04.184177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184177 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184469 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-5c35beff-5578-4695-8a6f-bb7aebda76a4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups/3c180698-7398-4106-96b0-85ffd84015a7 HTTP/1.1" status: 404 len: 347 time: 0.0131314 Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.184579 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47f9b118-78bb-46f7-ace5-2e1eac755126 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:04.186280 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39064) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:04.313705 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Deleting port 298c6a9e-8b70-4658-a027-294e132f8325 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:04.314039 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.389853 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.390102 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.401430 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Calling delete_port for 298c6a9e-8b70-4658-a027-294e132f8325 owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:04.614114 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.644760 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'Port': ['ID=298c6a9e-8b70-4658-a027-294e132f8325,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:04.698294 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.700870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:04.702005 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ee343cfe-2658-4902-8eb5-0993e044a893 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "DELETE /v2.0/floatingips/75c9558a-aacc-4bdb-8c21-b9e3bcdd4ce6 HTTP/1.1" status: 204 len: 168 time: 0.5143197 Nov 11 14:35:06.028642 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-7d42a973-ab6e-4d69-8a88-a632b735172b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.143433 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39070) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:06.147958 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group': {'name': 'tempest-securitygroup--616632793', 'description': 'tempest-description--1547706761'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:06.214255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.288326 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.360279 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.388176 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:06.459593 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.460893 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-71f3f349-9c85-4f8c-a256-87d30fa95f4a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3164406 Nov 11 14:35:06.463859 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39072) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:06.471626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group_rule': {'security_group_id': '9f3341e5-9344-4fd3-8ab7-d02f8723c3bb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:06.553370 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.618873 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.691296 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.709039 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f0048bb3-7641-416a-8245-08d2f58c21b6,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:06.796352 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.797577 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-282b22b5-5861-40f0-b6c4-c5c8a58e7c80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3327768 Nov 11 14:35:06.800227 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39074) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:06.804488 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'security_group_rule': {'security_group_id': '9f3341e5-9344-4fd3-8ab7-d02f8723c3bb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:06.901622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:06.954892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.042664 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798145'] for security_group_rule, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.059542 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98ba575a-791c-4c69-bcaf-9329d4b08f86,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:07.130573 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.131804 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4295ba86-8313-43df-9310-607d94810232 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3306675 Nov 11 14:35:07.135005 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39076) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:07.140478 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'floatingip': {'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:07.228601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.322064 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.426435 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_common [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Allocated IP 172.27.1.252 (2695a271-995b-4caa-b664-bb0645c2bc02/872490fe-8b51-42ad-a4a2-14f82622d8e6/c7844781-46a3-48a2-8723-c6d305fb0814) {{(pid=102268) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:35:07.525363 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.634872 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.670438 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Network 2695a271-995b-4caa-b664-bb0645c2bc02 is already hosted by enough agents. {{(pid=102268) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:35:07.673187 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Resources bound (agent type, host, resource id): {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:35:07.678499 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Received port after_create {{(pid=102268) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:35:07.705261 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=c7844781-46a3-48a2-8723-c6d305fb0814,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:07.769140 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.846006 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:07.992775 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:08.048507 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-125906242'] for port, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:08.120582 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=c7844781-46a3-48a2-8723-c6d305fb0814,revision_number=2']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:08.128224 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:08.202656 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:08.203937 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-6949d07c-dffe-4c7f-86ce-7a638f0a2c43 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.0678630 Nov 11 14:35:08.342780 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:35:08.406246 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-3d243393-8c06-4d21-a7e6-119a73f05e82 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?name=tempest-securitygroup--616632793&fields=id&tenant_id=1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 267 time: 0.0460386 Nov 11 14:35:08.459976 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-39c4b5eb-1125-4725-94c5-ed0123918939 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:08.508256 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-ccc7d094-7ff8-45fb-9b9a-6b48b4bf3320 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:08.509732 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-ccc7d094-7ff8-45fb-9b9a-6b48b4bf3320 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 811 time: 0.1008747 Nov 11 14:35:08.524615 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-2b4ac7ab-62cb-4d98-8506-a51f29d9f740 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/quotas/1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 375 time: 0.0087335 Nov 11 14:35:08.576074 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-aa9b75bd-baa4-4e36-9264-1dc310048ff0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0464432 Nov 11 14:35:08.591641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-d272c56e-b075-4972-8c16-8d11f4936570 service neutron] http://10.222.0.10:9696/v2.0/extensions returned with HTTP 200 {{(pid=102267) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 11 14:35:08.593142 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-d272c56e-b075-4972-8c16-8d11f4936570 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049684 Nov 11 14:35:08.683481 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-af3f7f8a-afad-4246-bb56-4d4f9a0b43ae service neutron] 10.222.0.10 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846786 Nov 11 14:35:08.771137 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-6de1f373-f0ff-4a50-9b85-d30c18068a83 service neutron] 10.222.0.10 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818202 Nov 11 14:35:09.018682 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-4588fd2b-5b1d-4b5a-ab01-8bb088723856 req-462b0c39-673a-4e04-b064-60ffb32e2dd9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0299084 Nov 11 14:35:09.674316 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:10.099547 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6e56959e-e031-4834-9e09-6daa211af688 req-8690f846-76f4-4e7d-9429-be3209b0f0ad tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0306401 Nov 11 14:35:10.777017 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:11.175010 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e5fbac3f-db9a-4d1c-89e2-f807ed3e5058 req-e4baeabd-9f8c-44cc-a7b7-4d57bde7b88f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0257297 Nov 11 14:35:11.742533 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:12.131293 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:12.254823 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-802c17a7-478b-42bd-82a6-b50c02574e2c req-2f5867c0-80d5-492d-bb64-a9d76d25599d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0265830 Nov 11 14:35:13.347479 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-c5775777-7594-45d6-9a01-d8066b4a34c8 req-061b5ee9-0ccb-4320-b669-0bd3ace44d72 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0257051 Nov 11 14:35:14.441130 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b7f2626c-1322-4502-b185-0017fb95422d req-40bf1016-19ba-484f-b2a6-d0166bdfe060 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0251486 Nov 11 14:35:14.922748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-bce84675-18c0-455a-a8b0-f23c9121135c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:14.924214 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-bce84675-18c0-455a-a8b0-f23c9121135c tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 811 time: 0.1030324 Nov 11 14:35:14.984106 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-aab1c6fe-2955-4cc2-852a-a4de1b11f604 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1dfdd8159d1f45c99f739dea5093090b HTTP/1.1" status: 200 len: 379 time: 0.0498574 Nov 11 14:35:14.992245 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'port': {'device_id': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'admin_state_up': True, 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'security_groups': ['9f3341e5-9344-4fd3-8ab7-d02f8723c3bb']}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:15.177233 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Made reservation on behalf of 1dfdd8159d1f45c99f739dea5093090b for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:35:15.180805 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.308504 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Allocated IP 172.20.0.13 (c7053be2-46f8-424c-a8b5-3cba0c2fb790/b823154a-6f60-4185-ba89-f69641669a9e/5172ee0c-ea3e-44e9-b520-47bb5c4ea808) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:35:15.440362 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.526318 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.536479 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-10466c0d-8a0a-4828-a402-80baf74d25b1 req-7a63885d-199f-4c73-90a4-4fd063e85520 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0264943 Nov 11 14:35:15.569636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:35:15.574544 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:35:15.578277 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:35:15.588028 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event updated for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:15.632332 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:15.632946 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.708858 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-fa12989a-a933-490e-a1f9-c3b6b302e155 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7200177 Nov 11 14:35:15.722541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Request body: {'port': {'device_id': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:15.777848 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.811861 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-9d18a801-2ae4-4ba6-aa23-4efc0ebd64d3 None None] Provisioning complete for port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:35:15.812490 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-9d18a801-2ae4-4ba6-aa23-4efc0ebd64d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:15.845666 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-9d18a801-2ae4-4ba6-aa23-4efc0ebd64d3 None None] Port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:35:16.032198 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:35:16.039574 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:16.051142 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Transition to ACTIVE for port object 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:35:16.122658 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:16.175733 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Pushing event updated for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:16.248637 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Attempting to bind port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:35:16.249512 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Attempting to bind port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:35:16.249836 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Attempting to bind port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:35:16.254272 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:35:16.254585 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Attempting to bind port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 on network c7053be2-46f8-424c-a8b5-3cba0c2fb790 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:35:16.259498 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 35, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:35:16.259832 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Checking segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:35:16.260210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Bound using segment: {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:35:16.260636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Bound port: 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '67956f27-c765-49dd-8650-765667d8ca05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 319, 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:35:16.260988 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:16.333517 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:35:16.336474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:35:16.414552 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:16.461916 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.462541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:16.464027 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] 10.222.0.11 "PUT /v2.0/ports/5172ee0c-ea3e-44e9-b520-47bb5c4ea808 HTTP/1.1" status: 200 len: 1094 time: 0.7464397 Nov 11 14:35:16.464470 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:16.466699 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d962d304-0697-4377-831f-483fd94530f3" -d '{"events": [{"name": "network-changed", "server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:16.491649 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b286939d-8280-4cef-8b0e-d46ab0e4fe4d service neutron] Pushing event updated for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:16.507151 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45b203c5-dfb5-4538-b2de-9f00d4b2b6bd x-openstack-request-id: req-45b203c5-dfb5-4538-b2de-9f00d4b2b6bd {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:16.507493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:16.507747 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-45b203c5-dfb5-4538-b2de-9f00d4b2b6bd {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:16.508290 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'status': 'completed', 'code': 200} Nov 11 14:35:16.576174 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d962d304-0697-4377-831f-483fd94530f3 req-a185dd49-dfde-474f-8673-8e4790b0fd1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.578023 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d962d304-0697-4377-831f-483fd94530f3 req-a185dd49-dfde-474f-8673-8e4790b0fd1a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 1097 time: 0.0459371 Nov 11 14:35:16.658935 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e1bed0-a2d0-4459-b366-d7aa1833278b req-d37ea451-36b8-40c7-b788-8c43ddee5b2f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.660701 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-66e1bed0-a2d0-4459-b366-d7aa1833278b req-d37ea451-36b8-40c7-b788-8c43ddee5b2f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 944 time: 0.0523353 Nov 11 14:35:16.684341 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d962d304-0697-4377-831f-483fd94530f3 req-36c98b6a-2811-4f8c-800d-12fc60d339bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.685789 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d962d304-0697-4377-831f-483fd94530f3 req-36c98b6a-2811-4f8c-800d-12fc60d339bf service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=1dfdd8159d1f45c99f739dea5093090b&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1000261 Nov 11 14:35:16.713494 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-66e1bed0-a2d0-4459-b366-d7aa1833278b req-77d315f2-0f90-4aad-8e1b-c8383526cb67 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467665 Nov 11 14:35:16.784613 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d962d304-0697-4377-831f-483fd94530f3 req-324992e8-e929-4086-aa42-9da01bb485f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.786058 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d962d304-0697-4377-831f-483fd94530f3 req-324992e8-e929-4086-aa42-9da01bb485f9 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0931699 Nov 11 14:35:16.859598 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-f93117d0-ebfa-4120-97b9-4aef00885322 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.860989 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-f93117d0-ebfa-4120-97b9-4aef00885322 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 1097 time: 0.0397077 Nov 11 14:35:16.904407 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-e9a1f2c5-7e63-48a6-94f3-b72b27d3172c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808 HTTP/1.1" status: 200 len: 217 time: 0.0357423 Nov 11 14:35:16.951602 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-37c33c50-d036-4558-b6f0-7e3a7271199b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.953040 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-37c33c50-d036-4558-b6f0-7e3a7271199b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0421064 Nov 11 14:35:16.996491 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-76d262ed-14c9-4198-9c54-92b41f6bdce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:16.997886 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-76d262ed-14c9-4198-9c54-92b41f6bdce6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0379956 Nov 11 14:35:17.088115 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-ca097a82-cc07-494f-9b9c-be9ddb3ec1c4 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823529 Nov 11 14:35:17.177573 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-e4921f68-90eb-4fee-9ea6-d6cedd21f4fa req-4e14c57a-15d9-4ca2-960a-f5ddf6d6a168 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824420 Nov 11 14:35:17.181978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39134) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:17.338448 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Deleting port fe0d99fd-86ac-441d-b07b-f5a9946f1290 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:17.338785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:17.414757 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:17.415004 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:17.426230 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Calling delete_port for fe0d99fd-86ac-441d-b07b-f5a9946f1290 owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:17.619697 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:17.646837 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event deleted for resources: {'Port': ['ID=fe0d99fd-86ac-441d-b07b-f5a9946f1290,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:17.703632 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:17.703965 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Floating IP 24404322-f956-4643-8f7c-6e5be0ff82ad disassociated (deleted). External IP: 172.27.1.235, port: 39852042-e8c3-45ba-9635-1bcf0760856e. Nov 11 14:35:17.877865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54432cbf-7615-4c08-901e-ffd66bef75b2 req-a3f05281-0321-4983-a83c-18bdd7bb0f5b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:17.879302 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-54432cbf-7615-4c08-901e-ffd66bef75b2 req-a3f05281-0321-4983-a83c-18bdd7bb0f5b tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 944 time: 0.0932493 Nov 11 14:35:17.967178 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-54432cbf-7615-4c08-901e-ffd66bef75b2 req-9182cef2-b280-4885-95b1-1576933106fb tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0819104 Nov 11 14:35:17.976757 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Router d633719b-30dc-4e87-97ff-8877f6c9e64b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:35:18.080263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:35:18.085050 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:18.090262 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Sync routers for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:35:18.099668 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:18.100271 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:18.111064 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-456e74d4-26ed-4314-9197-586cd92fdc75 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "DELETE /v2.0/floatingips/24404322-f956-4643-8f7c-6e5be0ff82ad HTTP/1.1" status: 204 len: 168 time: 0.9272411 Nov 11 14:35:18.205455 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:18.411280 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:18.437670 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Checking router: d633719b-30dc-4e87-97ff-8877f6c9e64b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:35:18.446491 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:18.447133 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:18.515010 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b09332-240f-4754-8b0e-71827063a556 req-c4c80019-8e0b-4744-bb12-4ab79910fa2e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:18.516558 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d0b09332-240f-4754-8b0e-71827063a556 req-c4c80019-8e0b-4744-bb12-4ab79910fa2e tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0531414 Nov 11 14:35:18.517012 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:18.520541 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4302d458-48fc-4aee-a618-afaed41d3a8b" -d '{"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:18.555091 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:18.558279 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e590d7e-1001-4fa0-8be5-8cce3d9b1290 x-openstack-request-id: req-3e590d7e-1001-4fa0-8be5-8cce3d9b1290 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:18.558572 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:18.558819 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-3e590d7e-1001-4fa0-8be5-8cce3d9b1290 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:18.559208 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'status': 'completed', 'code': 200} Nov 11 14:35:18.572634 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d0b09332-240f-4754-8b0e-71827063a556 req-1a1fcb37-8648-4b10-8493-96a7b1a4dc17 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496259 Nov 11 14:35:18.618502 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-8f65974c-6ece-4f1b-be5c-32b26cea0fcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:18.620039 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-8f65974c-6ece-4f1b-be5c-32b26cea0fcd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 1099 time: 0.0405686 Nov 11 14:35:18.757472 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:18.790351 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1cafd0-b18a-4d08-b068-9b3b76607a54 None None] The sync data for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi is: [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:30:42Z', 'revision_number': 4, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': '5458d736-0c70-4a69-a8fe-2619fa5dc5a3', 'name': '', 'network_id': '423f335f-df68-4380-9f3a-d51e1811cc79', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'mac_address': 'fa:16:3e:f8:7d:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_interface', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:41Z', 'updated_at': '2021-11-11T14:30:47Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'subnets': [{'id': '0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:35:18.958244 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-39ad3d47-2eb4-4704-9241-cfe79f54b2b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:18.959814 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-39ad3d47-2eb4-4704-9241-cfe79f54b2b0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 200 len: 908 time: 0.3333273 Nov 11 14:35:19.003019 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-61799773-c52b-4f55-a85c-d506072f82da service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 200 len: 217 time: 0.0355144 Nov 11 14:35:19.015198 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a7ca6b9-bc4a-4a20-bf85-e860f4cf7cf4 None None] New status for floating IP 24404322-f956-4643-8f7c-6e5be0ff82ad: DOWN {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:35:19.056145 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-b3bee63b-369a-413d-858e-ee459460b2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:19.057702 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-b3bee63b-369a-413d-858e-ee459460b2d8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 200 len: 846 time: 0.0456173 Nov 11 14:35:19.090923 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825e07bd-e698-43c7-a22f-87c41dc866e0 req-bd24d707-6019-440a-bdf3-53327fb82635 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:19.093128 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-825e07bd-e698-43c7-a22f-87c41dc866e0 req-bd24d707-6019-440a-bdf3-53327fb82635 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 944 time: 0.0533903 Nov 11 14:35:19.105161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-d87c129f-a2ac-4286-9569-4b7dd9998536 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:19.106652 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-d87c129f-a2ac-4286-9569-4b7dd9998536 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=423f335f-df68-4380-9f3a-d51e1811cc79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411477 Nov 11 14:35:19.145078 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-825e07bd-e698-43c7-a22f-87c41dc866e0 req-d6314137-06ab-45de-af46-4957c3dd8134 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454543 Nov 11 14:35:19.203231 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-28032cb2-7089-48d4-9a51-1dea63e31ef7 service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874290 Nov 11 14:35:19.293828 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-4302d458-48fc-4aee-a618-afaed41d3a8b req-5c215b1f-3096-4bab-97bc-bd12ceba1f2d service neutron] 10.222.0.11 "GET /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825963 Nov 11 14:35:19.689949 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f331a5b-97fe-4552-a2e7-be1d01c6500a req-058d11de-8c10-46bf-94cd-7ef840ea67de tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:19.691450 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f331a5b-97fe-4552-a2e7-be1d01c6500a req-058d11de-8c10-46bf-94cd-7ef840ea67de tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0491655 Nov 11 14:35:19.739887 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f331a5b-97fe-4552-a2e7-be1d01c6500a req-9f9dc8c2-9dbb-4020-bb0c-b30877b12421 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/security-groups?id=83058885-fc82-4d17-843e-77fc2ba0dd4e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427260 Nov 11 14:35:19.866029 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:35:19.960311 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:19.971604 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'port_id': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'mac_address': 'fa:16:3e:af:fb:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 319, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:35:20.007606 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.017305 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-616b86ef-7d01-45ee-a56b-660600daadea tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:20.018771 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-616b86ef-7d01-45ee-a56b-660600daadea tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.11 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 946 time: 0.0467703 Nov 11 14:35:20.020462 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:35:20.040409 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:20.105763 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.128795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Deleting port 39852042-e8c3-45ba-9635-1bcf0760856e {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:20.128795 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.154634 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:20.162143 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.162504 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.162829 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.163155 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.163511 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.163839 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.164160 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.164483 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.164799 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.165115 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.165432 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.165777 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:35:20.213794 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] For port 39852042-e8c3-45ba-9635-1bcf0760856e, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=39852042-e8c3-45ba-9635-1bcf0760856e,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:20.214212 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.227662 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Calling delete_port for 39852042-e8c3-45ba-9635-1bcf0760856e owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:20.261072 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dedf6c94-6f38-4655-b26e-0372e21469d4 req-ba3c4aa8-0e01-4391-ad97-4bfaf133a6f0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:20.263828 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dedf6c94-6f38-4655-b26e-0372e21469d4 req-ba3c4aa8-0e01-4391-ad97-4bfaf133a6f0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 945 time: 0.0519280 Nov 11 14:35:20.314155 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dedf6c94-6f38-4655-b26e-0372e21469d4 req-a1629ce9-5e58-4340-82ad-1bd2b63acd80 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442786 Nov 11 14:35:20.323014 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['5172ee0c-ea3e-44e9-b520-47bb5c4ea808'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:35:20.423160 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.451069 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event deleted for resources: {'Port': ['ID=39852042-e8c3-45ba-9635-1bcf0760856e,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:20.503106 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] No DVR routers for this DVR port 39852042-e8c3-45ba-9635-1bcf0760856e on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:20.505720 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:20.509196 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-a33ce4d9-0558-4667-a712-f9c4d8ba2b4a req-1853bf1b-1924-4770-84b7-4830562d27fa tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.11 "DELETE /v2.0/ports/39852042-e8c3-45ba-9635-1bcf0760856e HTTP/1.1" status: 204 len: 173 time: 0.4840772 Nov 11 14:35:20.559907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-deleted', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:20.562257 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f63a37a-d6b6-4ed0-88db-2855ef9f5aef" -d '{"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-deleted", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:20.597324 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e21b01e7-507a-41c7-87c8-442f6a646709 x-openstack-request-id: req-e21b01e7-507a-41c7-87c8-442f6a646709 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:20.597696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d30f7cd4-4867-4105-8978-708aa6d04e74", "name": "network-vif-deleted", "tag": "39852042-e8c3-45ba-9635-1bcf0760856e", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:20.597959 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-e21b01e7-507a-41c7-87c8-442f6a646709 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:20.598360 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd30f7cd4-4867-4105-8978-708aa6d04e74', 'name': 'network-vif-deleted', 'tag': '39852042-e8c3-45ba-9635-1bcf0760856e', 'status': 'completed', 'code': 200} Nov 11 14:35:20.834485 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6d59b89c-1909-4a27-a062-a7587d952db4 req-e46a34b1-ae44-4b1b-aa19-7ebcb71e451b tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0294678 Nov 11 14:35:21.429501 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df830305-7c65-4841-a85c-cb3923241545 req-f286f456-b92a-466a-aee0-ee2654c8ee5d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:21.431079 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-df830305-7c65-4841-a85c-cb3923241545 req-f286f456-b92a-466a-aee0-ee2654c8ee5d tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 945 time: 0.0485511 Nov 11 14:35:21.479297 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-df830305-7c65-4841-a85c-cb3923241545 req-5b09113e-96a0-47e7-a310-76d4993a5867 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414917 Nov 11 14:35:21.889951 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:35:21.939423 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-882caa8e-8ec4-4c6e-8329-e564dac20bf7 req-e4597ffb-9aa5-4584-bcb4-e3ae1c7c5090 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "GET /v2.0/ports?device_id=d30f7cd4-4867-4105-8978-708aa6d04e74 HTTP/1.1" status: 200 len: 210 time: 0.0264976 Nov 11 14:35:22.014194 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:35:22.018177 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:35:22.018568 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:22.094666 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:22.116350 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:22.118486 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2744243a-bd20-42ca-a938-09c938926d49" -d '{"events": [{"server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "name": "network-vif-plugged", "status": "completed", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:22.131553 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:22.213882 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6fd49e0b-39e1-4f64-9650-975163416ae6 x-openstack-request-id: req-6fd49e0b-39e1-4f64-9650-975163416ae6 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:22.214167 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "name": "network-vif-plugged", "status": "completed", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:22.214412 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-6fd49e0b-39e1-4f64-9650-975163416ae6 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:22.214797 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'code': 200} Nov 11 14:35:22.257124 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:22.303781 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:22.518251 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2ae7bd-c02a-4994-a67c-c2c31462bf6f req-73b88721-3dbf-47de-8e1b-84ef6f9b1817 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:22.519853 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7b2ae7bd-c02a-4994-a67c-c2c31462bf6f req-73b88721-3dbf-47de-8e1b-84ef6f9b1817 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 1099 time: 0.0398498 Nov 11 14:35:22.564831 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7b2ae7bd-c02a-4994-a67c-c2c31462bf6f req-0d64155b-dce4-4834-b9fb-ae3a7fc1acfa service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0373580 Nov 11 14:35:22.592292 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1406b74-854c-404b-a23a-0c3182c1aa25 req-1f091adb-62c1-4335-b9ae-6a2a81426d85 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:22.594351 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e1406b74-854c-404b-a23a-0c3182c1aa25 req-1f091adb-62c1-4335-b9ae-6a2a81426d85 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0483365 Nov 11 14:35:22.640721 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e1406b74-854c-404b-a23a-0c3182c1aa25 req-e87ee161-62cc-4196-8510-1dfd8b0d8862 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403628 Nov 11 14:35:22.992308 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39166) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:23.050045 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:23.074114 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:23.202575 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:23.205367 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:23.206531 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] 10.222.0.10 "DELETE /v2.0/security-groups/83058885-fc82-4d17-843e-77fc2ba0dd4e HTTP/1.1" status: 204 len: 168 time: 0.2132449 Nov 11 14:35:23.216224 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89f34c75-cfcf-4f4c-a94e-cd2b9370def9 tempest-TestShelveInstance-1224703713 tempest-TestShelveInstance-1224703713-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=83058885-fc82-4d17-843e-77fc2ba0dd4e,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:23.306566 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39170) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:23.649263 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:23.813883 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db23336b-981c-4ebc-b9e5-a28a625e4db0 req-16f95dec-2503-4d0a-bbe8-7a03cd95535a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:23.815329 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-db23336b-981c-4ebc-b9e5-a28a625e4db0 req-16f95dec-2503-4d0a-bbe8-7a03cd95535a tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0927310 Nov 11 14:35:23.894306 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-db23336b-981c-4ebc-b9e5-a28a625e4db0 req-5bacd3e9-e6f1-4342-839d-a525e9a8049e tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588276 Nov 11 14:35:23.898546 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:23.923155 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 39852042-e8c3-45ba-9635-1bcf0760856e {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:23.923522 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 39852042-e8c3-45ba-9635-1bcf0760856e not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:23.969429 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Deleting port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:23.969762 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:24.047918 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] For port 5458d736-0c70-4a69-a8fe-2619fa5dc5a3, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:24.048300 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:24.060333 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Calling delete_port for 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:24.308599 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:24.334619 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Pushing event deleted for resources: {'Port': ['ID=5458d736-0c70-4a69-a8fe-2619fa5dc5a3,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:24.507894 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:24.714558 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Router d633719b-30dc-4e87-97ff-8877f6c9e64b has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:35:24.816628 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:35:24.821691 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-05037b55-a30f-4bdf-9318-a5e29d9b0a21 admin admin] 10.222.0.10 "PUT /v2.0/routers/d633719b-30dc-4e87-97ff-8877f6c9e64b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5140843 Nov 11 14:35:24.824356 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39174) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:24.827155 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Sync routers for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:35:24.837650 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:24.838271 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:24.931522 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks [] for router, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.016119 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b997e3ab-1e4d-4d36-9fe5-420eef65d81e req-c22b8804-4f19-41de-a476-c7cf1b6a1eca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:25.017498 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b997e3ab-1e4d-4d36-9fe5-420eef65d81e req-c22b8804-4f19-41de-a476-c7cf1b6a1eca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0503008 Nov 11 14:35:25.031301 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:25.038043 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.071803 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b997e3ab-1e4d-4d36-9fe5-420eef65d81e req-52ff7a36-6cf1-430f-b480-dce53bfb7aaa tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477257 Nov 11 14:35:25.194164 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Deleting port e890221d-39e7-4706-8680-f1ff9d15b0f2 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:25.194511 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.205611 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a05874-89ab-4447-8f4e-ffb976e69282 req-20ff7c90-83ed-41fb-b303-624f4b3bbe66 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:25.207101 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-38a05874-89ab-4447-8f4e-ffb976e69282 req-20ff7c90-83ed-41fb-b303-624f4b3bbe66 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0634937 Nov 11 14:35:25.212166 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191'}], 'enable_snat': True}, 'gw_port_id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:35:24Z', 'revision_number': 5, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port': {'id': 'e890221d-39e7-4706-8680-f1ff9d15b0f2', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:a6:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 594, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:38Z', 'updated_at': '2021-11-11T14:30:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:25.216071 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39180) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:25.221059 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Request body: {'floatingip': {'port_id': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808'}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:35:25.243274 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Checking router: d633719b-30dc-4e87-97ff-8877f6c9e64b for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:35:25.251533 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Routers {'d633719b-30dc-4e87-97ff-8877f6c9e64b'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:25.252139 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['d633719b-30dc-4e87-97ff-8877f6c9e64b'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:25.260623 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, before_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.287796 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] For port e890221d-39e7-4706-8680-f1ff9d15b0f2, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=e890221d-39e7-4706-8680-f1ff9d15b0f2,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:25.288134 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.300439 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Calling delete_port for e890221d-39e7-4706-8680-f1ff9d15b0f2 owned by network:router_gateway {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:25.336518 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] Set router d633719b-30dc-4e87-97ff-8877f6c9e64b gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:25.390416 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:35:25Z', 'revision_number': 6, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:25.420345 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55bbe166-391d-4d02-8f3f-043c3358c2c3 None None] The sync data for ids ['d633719b-30dc-4e87-97ff-8877f6c9e64b'] in dv-cinder-777031-9-iscsi is: [{'id': 'd633719b-30dc-4e87-97ff-8877f6c9e64b', 'name': 'tempest-TestShelveInstance-71527190-router', 'tenant_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:37Z', 'updated_at': '2021-11-11T14:35:25Z', 'revision_number': 6, 'project_id': '8cac4cebe6754e1a9f7a0dc1d0714835', 'gw_port_host': None}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:35:25.522888 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.550660 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Pushing event deleted for resources: {'Port': ['ID=e890221d-39e7-4706-8680-f1ff9d15b0f2,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:25.617275 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.955627 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.957762 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:25.978487 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.048591 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.071546 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.072067 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d633719b-30dc-4e87-97ff-8877f6c9e64b {{(pid=102267) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:35:26.076385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.081517 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-556d14a6-5af3-4dd1-a611-a022913857e1 admin admin] 10.222.0.10 "DELETE /v2.0/routers/d633719b-30dc-4e87-97ff-8877f6c9e64b HTTP/1.1" status: 204 len: 168 time: 1.2522857 Nov 11 14:35:26.081517 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39182) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:26.128696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Deleting subnet 0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:35:26.133046 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.150814 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.db.l3_db [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Floating IP 838aceff-139b-4089-890f-c7d1e3b32494 associated. External IP: 172.27.1.252, port: 5172ee0c-ea3e-44e9-b520-47bb5c4ea808. Nov 11 14:35:26.166952 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.256593 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.365385 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102268) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:35:26.394528 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.420543 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:26.426660 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.432440 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-8da8aa39-7f41-460f-9ea5-b2a62789b581 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/0ff45f98-1c6a-4f24-bcdf-6fdd0167dd72 HTTP/1.1" status: 204 len: 168 time: 0.3491056 Nov 11 14:35:26.432998 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-130e4473-54ba-4e2c-a32a-52c0a18fa6da None None] Network 423f335f-df68-4380-9f3a-d51e1811cc79 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:35:26.433474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39184) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:26.555095 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.558364 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102268) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:35:26.563408 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.563671 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device e890221d-39e7-4706-8680-f1ff9d15b0f2 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:26.586715 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:35:26.592020 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: e890221d-39e7-4706-8680-f1ff9d15b0f2 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:26.592020 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device e890221d-39e7-4706-8680-f1ff9d15b0f2 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:26.592020 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:26.607907 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-459c069a-e8ff-4a75-809c-f6db0508f237 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "PUT /v2.0/floatingips/838aceff-139b-4089-890f-c7d1e3b32494 HTTP/1.1" status: 200 len: 992 time: 1.3826487 Nov 11 14:35:26.625136 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:26.625136 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:26.633395 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808'}] {{(pid=102268) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:35:26.635738 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5568499f0b03255fab0820b8f35c02981b0dac33c57e5d47148d72e21c8e45d9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-064a6214-3467-4f1c-b028-f3981ae557c6" -d '{"events": [{"name": "network-changed", "server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808"}]}' {{(pid=102268) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:35:26.654215 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:26.654551 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 5458d736-0c70-4a69-a8fe-2619fa5dc5a3 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:26.668922 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Deleting port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:26.669124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.706476 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] DHCP port deletion for 423f335f-df68-4380-9f3a-d51e1811cc79 request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:35:26.741760 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] For port 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96d6960e-f5a0-46c1-b19c-7fa0038487d9,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:26.742160 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.757287 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:26.757590 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Calling delete_port for 96d6960e-f5a0-46c1-b19c-7fa0038487d9 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:26.760235 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:35:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-428341ab-5b5e-47d3-a17d-82f7527e016c x-openstack-request-id: req-428341ab-5b5e-47d3-a17d-82f7527e016c {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:35:26.760522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808", "status": "completed", "code": 200}]} {{(pid=102268) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:35:26.760767 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-428341ab-5b5e-47d3-a17d-82f7527e016c {{(pid=102268) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:35:26.761403 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'status': 'completed', 'code': 200} Nov 11 14:35:26.820698 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-751a443b-66ec-42c6-9248-5be980598bf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:26.822238 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-751a443b-66ec-42c6-9248-5be980598bf2 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 1099 time: 0.0417893 Nov 11 14:35:26.846515 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Deleting port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:26.846868 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.894510 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.925092 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-94c41aa5-20be-4548-aa1b-56082adc48af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:26.925927 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Pushing event deleted for resources: {'Port': ['ID=96d6960e-f5a0-46c1-b19c-7fa0038487d9,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:26.926592 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-94c41aa5-20be-4548-aa1b-56082adc48af service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.0976121 Nov 11 14:35:26.932879 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] No DVR routers for this DVR port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:26.980303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] For port 96d6960e-f5a0-46c1-b19c-7fa0038487d9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96d6960e-f5a0-46c1-b19c-7fa0038487d9,segment=NetworkSegment(cb3037f5-86ce-4286-bbcf-8752577b0c73),segment_id=cb3037f5-86ce-4286-bbcf-8752577b0c73)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:26.980707 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:26.997752 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Calling delete_port for 96d6960e-f5a0-46c1-b19c-7fa0038487d9 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:27.003763 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.005958 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-799e152d-e682-4056-acd8-2d52aed15e02 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808 HTTP/1.1" status: 200 len: 1000 time: 0.0721004 Nov 11 14:35:27.024382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['423f335f-df68-4380-9f3a-d51e1811cc79']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.034340 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb3037f5-86ce-4286-bbcf-8752577b0c73') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.034618 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb3037f5-86ce-4286-bbcf-8752577b0c73') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.043875 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.057459 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.058977 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-955b6ccf-bb95-4319-b272-670aaa160d32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:27.060632 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-955b6ccf-bb95-4319-b272-670aaa160d32 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0478342 Nov 11 14:35:27.064760 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:35:27.065141 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:35:27.066817 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:35:27.108787 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-a1b4bf21-c050-40cb-9a6c-d2518ca7a8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:27.110387 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-a1b4bf21-c050-40cb-9a6c-d2518ca7a8f4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419562 Nov 11 14:35:27.129328 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.159962 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] No DVR routers for this DVR port 96d6960e-f5a0-46c1-b19c-7fa0038487d9 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:27.169055 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '838aceff-139b-4089-890f-c7d1e3b32494', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.252', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:af:fb:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:35:07Z', 'updated_at': '2021-11-11T14:35:25Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.169055 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f60fc7-3a1a-4042-8fcc-31f0b859d35b None None] Pushing event deleted for resources: {'Port': ['ID=96d6960e-f5a0-46c1-b19c-7fa0038487d9,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:27.196928 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.202792 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.204253 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:35:27.206931 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] 10.222.0.10 "DELETE /v2.0/networks/423f335f-df68-4380-9f3a-d51e1811cc79 HTTP/1.1" status: 204 len: 168 time: 0.7729862 Nov 11 14:35:27.214285 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:27.214972 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.216158 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39192) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:27.219915 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b18985-1bbc-4cbe-909b-5c1b95f27e29 admin admin] Pushing event deleted for resources: {'Network': ['ID=423f335f-df68-4380-9f3a-d51e1811cc79,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:27.258561 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-599bdb63-dbf8-4496-bba7-fff6a8d61fe3 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403790 Nov 11 14:35:27.321748 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:27.435273 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-064a6214-3467-4f1c-b028-f3981ae557c6 req-88500e11-35a7-4a00-9992-d1583f659368 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1688170 Nov 11 14:35:27.539439 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '838aceff-139b-4089-890f-c7d1e3b32494', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.252', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:af:fb:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:35:07Z', 'updated_at': '2021-11-11T14:35:25Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:27.569686 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c823e79-899b-4815-b4a6-6ac274a83c47 None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_floatingips': [{'id': '838aceff-139b-4089-890f-c7d1e3b32494', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'floating_ip_address': '172.27.1.252', 'floating_network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'router_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'port_id': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'mac_address': 'fa:16:3e:af:fb:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-11T14:35:07Z', 'updated_at': '2021-11-11T14:35:25Z', 'revision_number': 1, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:35:27.640735 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.771744 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a28446f6-066f-44bf-aa07-25ac512d997d None None] New status for floating IP 838aceff-139b-4089-890f-c7d1e3b32494: ACTIVE {{(pid=102270) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:35:27.888717 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Deleting port 068b60f9-41f7-4bff-a739-8bc3dc2890c8 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:27.889040 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.965348 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] For port 068b60f9-41f7-4bff-a739-8bc3dc2890c8, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=068b60f9-41f7-4bff-a739-8bc3dc2890c8,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:27.965647 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:27.980960 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Calling delete_port for 068b60f9-41f7-4bff-a739-8bc3dc2890c8 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:28.217690 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:28.246054 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Pushing event deleted for resources: {'Port': ['ID=068b60f9-41f7-4bff-a739-8bc3dc2890c8,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:28.409636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:28.560376 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96d6960e-f5a0-46c1-b19c-7fa0038487d9 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:28.580617 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 96d6960e-f5a0-46c1-b19c-7fa0038487d9 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:28.580950 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96d6960e-f5a0-46c1-b19c-7fa0038487d9 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:28.628206 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Router 69d016ef-6608-4cdc-9804-51ddd7d75b43 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:35:28.730565 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:35:28.736003 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-70b53de3-8605-49db-bcc0-35c754313f9b admin admin] 10.222.0.10 "PUT /v2.0/routers/69d016ef-6608-4cdc-9804-51ddd7d75b43/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5188560 Nov 11 14:35:28.738490 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39196) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:28.739399 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Sync routers for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:35:28.749465 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:28.750074 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:28.844109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks [] for router, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:28.957495 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:28.981942 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:29.119508 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Deleting port 586db0b5-ecab-475d-9f81-49908f86ca54 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:29.119892 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.155948 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:35:28Z', 'revision_number': 5, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port': {'id': '586db0b5-ecab-475d-9f81-49908f86ca54', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:30:47Z', 'updated_at': '2021-11-11T14:30:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:29.186681 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Checking router: 69d016ef-6608-4cdc-9804-51ddd7d75b43 for host: dv-cinder-777031-9-iscsi {{(pid=102269) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:35:29.194873 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Routers {'69d016ef-6608-4cdc-9804-51ddd7d75b43'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102269) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:35:29.195506 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:35:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['69d016ef-6608-4cdc-9804-51ddd7d75b43'], 'active': True} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:29.198625 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] For port 586db0b5-ecab-475d-9f81-49908f86ca54, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=586db0b5-ecab-475d-9f81-49908f86ca54,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:29.199008 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.211223 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Calling delete_port for 586db0b5-ecab-475d-9f81-49908f86ca54 owned by network:router_gateway {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:29.302808 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvr_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] Set router 69d016ef-6608-4cdc-9804-51ddd7d75b43 gateway port host: None {{(pid=102269) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:35:29.357443 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_hamode_db [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:35:28Z', 'revision_number': 6, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102269) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:29.387758 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac0724d9-13c5-4e8f-98bc-f5d565e1e16c None None] The sync data for ids ['69d016ef-6608-4cdc-9804-51ddd7d75b43'] in dv-cinder-777031-9-iscsi is: [{'id': '69d016ef-6608-4cdc-9804-51ddd7d75b43', 'name': 'tempest-TestShelveInstance-1737394267-router', 'tenant_id': 'd718788844474b4099772cec122606af', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:30:46Z', 'updated_at': '2021-11-11T14:35:28Z', 'revision_number': 6, 'project_id': 'd718788844474b4099772cec122606af', 'gw_port_host': None}] {{(pid=102269) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:35:29.448552 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.475612 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Pushing event deleted for resources: {'Port': ['ID=586db0b5-ecab-475d-9f81-49908f86ca54,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:29.782379 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.871908 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.874057 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.994232 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:29.994711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 69d016ef-6608-4cdc-9804-51ddd7d75b43 {{(pid=102267) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:35:29.999822 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.000951 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-19c8f092-2f46-41af-b051-f9554a67f1bc admin admin] 10.222.0.10 "DELETE /v2.0/routers/69d016ef-6608-4cdc-9804-51ddd7d75b43 HTTP/1.1" status: 204 len: 168 time: 1.2614458 Nov 11 14:35:30.003446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39202) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:30.051005 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Deleting subnet 027d6a5f-872b-491e-8dc5-e75bc4d5bf2d {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:35:30.054014 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.087209 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.164838 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.294675 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.323283 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.328715 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/027d6a5f-872b-491e-8dc5-e75bc4d5bf2d HTTP/1.1" status: 204 len: 168 time: 0.3222842 Nov 11 14:35:30.328715 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df964c4-58a5-4675-8469-4bc706e34812 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=027d6a5f-872b-491e-8dc5-e75bc4d5bf2d,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:30.329003 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efe6f132-675c-4655-966f-73a52bee170c None None] Network 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:35:30.329504 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39204) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:30.408989 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.463052 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Deleting port ba8761f1-e519-497e-b3ea-252822e2d328 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:30.463577 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.527954 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] DHCP port deletion for 5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:35:30.533934 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] For port ba8761f1-e519-497e-b3ea-252822e2d328, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ba8761f1-e519-497e-b3ea-252822e2d328,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:30.534541 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.548802 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Calling delete_port for ba8761f1-e519-497e-b3ea-252822e2d328 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:30.557619 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 068b60f9-41f7-4bff-a739-8bc3dc2890c8 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:30.580529 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 068b60f9-41f7-4bff-a739-8bc3dc2890c8 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:30.580869 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 068b60f9-41f7-4bff-a739-8bc3dc2890c8 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:30.581288 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 586db0b5-ecab-475d-9f81-49908f86ca54 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:30.602181 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 586db0b5-ecab-475d-9f81-49908f86ca54 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:30.602525 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 586db0b5-ecab-475d-9f81-49908f86ca54 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:30.620114 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Deleting port ba8761f1-e519-497e-b3ea-252822e2d328 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:35:30.620488 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.685102 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] For port ba8761f1-e519-497e-b3ea-252822e2d328, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=ba8761f1-e519-497e-b3ea-252822e2d328,segment=NetworkSegment(001ac1d6-3e42-4f39-95e5-7a46d080774e),segment_id=001ac1d6-3e42-4f39-95e5-7a46d080774e)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:35:30.685498 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.697880 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Calling delete_port for ba8761f1-e519-497e-b3ea-252822e2d328 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:35:30.708474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.734002 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Pushing event deleted for resources: {'Port': ['ID=ba8761f1-e519-497e-b3ea-252822e2d328,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:30.739390 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] No DVR routers for this DVR port ba8761f1-e519-497e-b3ea-252822e2d328 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:30.775244 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.801252 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] Pushing event deleted for resources: {'Port': ['ID=ba8761f1-e519-497e-b3ea-252822e2d328,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:30.803007 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ead5f291-3d66-4369-aa30-fee028d176e6 None None] No DVR routers for this DVR port ba8761f1-e519-497e-b3ea-252822e2d328 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:35:30.814939 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.835225 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5e23d4c0-3fc9-4c3d-bd31-5197b9354e62']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:30.844751 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '001ac1d6-3e42-4f39-95e5-7a46d080774e') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:30.845040 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '001ac1d6-3e42-4f39-95e5-7a46d080774e') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:35:30.854275 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.866849 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.872444 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Releasing vlan 320 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:35:30.872807 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:35:30.874460 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:35:30.991282 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:30.996621 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:31.000373 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] 10.222.0.10 "DELETE /v2.0/networks/5e23d4c0-3fc9-4c3d-bd31-5197b9354e62 HTTP/1.1" status: 204 len: 168 time: 0.6692979 Nov 11 14:35:31.011431 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90fd0d34-a3aa-4fae-b56d-f97841c95082 admin admin] Pushing event deleted for resources: {'Network': ['ID=5e23d4c0-3fc9-4c3d-bd31-5197b9354e62,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:31.365302 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39210) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:31.409180 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b376ae6f-507f-4fee-b7d1-070596d188a1 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=8cac4cebe6754e1a9f7a0dc1d0714835&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0427244 Nov 11 14:35:31.411726 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39212) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:31.457991 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:31.478578 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:31.585640 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:31.588365 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:31.589444 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/a2abd799-9f34-47aa-b5d5-7c94b4c3a8f6 HTTP/1.1" status: 204 len: 168 time: 0.1768303 Nov 11 14:35:31.601129 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc2b97f-b54d-4b90-8b21-5ed470a8b503 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2abd799-9f34-47aa-b5d5-7c94b4c3a8f6,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:32.230842 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39220) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:32.271045 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-e5cfeba5-621e-46a2-b8b0-0d344f85a585 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=d718788844474b4099772cec122606af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0388806 Nov 11 14:35:32.273469 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39222) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:35:32.318596 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:32.339219 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:32.480980 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:32.483964 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:32.485145 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4d5dc671-ff0f-4187-844b-d29eea80be89 HTTP/1.1" status: 204 len: 168 time: 0.2107468 Nov 11 14:35:32.493382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d960e3-59ec-4f91-88e3-eae73d4e7054 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d5dc671-ff0f-4187-844b-d29eea80be89,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:35:32.525265 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ba8761f1-e519-497e-b3ea-252822e2d328 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:35:32.548411 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: ba8761f1-e519-497e-b3ea-252822e2d328 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:35:32.548834 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device ba8761f1-e519-497e-b3ea-252822e2d328 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:35:36.024958 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-18964e59-2ba8-4412-ba8e-784a4a974ac3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:38.494045 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-073c0061-bca2-42e9-89f4-44d5051daafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:39.685538 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:40.762567 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:41.719740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:42.185227 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:35:45.341289 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:35:51.761746 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-fd50e7e9-03c2-461e-8300-758407637389 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384822 Nov 11 14:35:51.851842 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12974449-bcb3-454c-bbcd-928194fadbfa req-6e0e8d00-4e81-4c80-b215-3bcf9a7e9a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:51.853271 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-6e0e8d00-4e81-4c80-b215-3bcf9a7e9a8e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1dfdd8159d1f45c99f739dea5093090b&device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 1099 time: 0.0394702 Nov 11 14:35:51.958785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12974449-bcb3-454c-bbcd-928194fadbfa req-1af548c6-a669-45b8-b89a-a576d5803b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:51.960191 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-1af548c6-a669-45b8-b89a-a576d5803b94 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 200 len: 912 time: 0.0867722 Nov 11 14:35:52.024939 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-d2419f59-ca53-4914-bff4-58f6cd25c81c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808 HTTP/1.1" status: 200 len: 1002 time: 0.0563443 Nov 11 14:35:52.075778 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12974449-bcb3-454c-bbcd-928194fadbfa req-66078562-624d-458f-a711-ed5c50087956 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:52.077703 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-66078562-624d-458f-a711-ed5c50087956 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 200 len: 850 time: 0.0457582 Nov 11 14:35:52.120780 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12974449-bcb3-454c-bbcd-928194fadbfa req-610b6670-d043-41c7-a658-20ef58a8b7d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:35:52.122237 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-610b6670-d043-41c7-a658-20ef58a8b7d0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c7053be2-46f8-424c-a8b5-3cba0c2fb790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378699 Nov 11 14:35:52.214082 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-8eecf14d-06ed-432f-8900-9b165eb212bc service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831325 Nov 11 14:35:52.303816 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-12974449-bcb3-454c-bbcd-928194fadbfa req-8502d3fd-57ec-499b-a416-fe33adb951b8 service neutron] 10.222.0.11 "GET /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817766 Nov 11 14:36:06.042128 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ca140528-afdd-4f15-ae3b-386e96f0bee3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:08.464741 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d774d4cf-35d7-4490-b2c2-c3d0763d8921 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:09.693349 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:10.770232 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:11.730434 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:12.173316 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:22.342123 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:36:25.992296 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508c3273-b80b-46fa-9279-660850fde28b req-8aaf8393-b13e-4d44-975c-b0245c3a37c0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:25.993753 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-508c3273-b80b-46fa-9279-660850fde28b req-8aaf8393-b13e-4d44-975c-b0245c3a37c0 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0493703 Nov 11 14:36:26.040918 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-508c3273-b80b-46fa-9279-660850fde28b req-aaffba6c-04a3-455e-9c0b-403643d2e8c8 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412395 Nov 11 14:36:27.157448 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57842e62-0fa7-48a1-921a-242a21c70b15 req-d84cfc24-2ab1-48e9-9441-5f99a30e7722 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:27.158930 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-57842e62-0fa7-48a1-921a-242a21c70b15 req-d84cfc24-2ab1-48e9-9441-5f99a30e7722 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0492892 Nov 11 14:36:27.205047 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-57842e62-0fa7-48a1-921a-242a21c70b15 req-6646272d-3c5d-4989-ad17-761e51274e68 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups?id=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397840 Nov 11 14:36:27.662576 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6693915a-8acc-460a-908c-f5f07addd849 req-9d453742-2503-4669-b3e8-90d8048bd1c9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:27.664036 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6693915a-8acc-460a-908c-f5f07addd849 req-9d453742-2503-4669-b3e8-90d8048bd1c9 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 946 time: 0.0514793 Nov 11 14:36:27.748135 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Deleting port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:27.748466 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:27.838556 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] For port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:36:27.838910 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:28.000404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:28.000761 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-393970'] for floatingip, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:28.001074 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.l3_db [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Floating IP 838aceff-139b-4089-890f-c7d1e3b32494 disassociated. External IP: 172.27.1.252, port: 5172ee0c-ea3e-44e9-b520-47bb5c4ea808. Nov 11 14:36:28.001410 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Calling delete_port for 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:28.179032 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:28.207306 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'Port': ['ID=5172ee0c-ea3e-44e9-b520-47bb5c4ea808,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:28.217337 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.217685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.218025 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.218358 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.218685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.219007 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.219336 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.219689 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.220013 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.220333 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.220654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.220971 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:28.298271 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-935a597b-7212-4385-8514-e481763376d9 req-22b0ea0a-44fa-48cb-893b-c324f8f42721 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0251396 Nov 11 14:36:28.330791 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:36:28.444308 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:36:28.454022 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:36:28.463751 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:36:28.464352 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:36:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:28.482748 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] No DVR routers for this DVR port 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:36:28.485284 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:28.489166 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-6693915a-8acc-460a-908c-f5f07addd849 req-ab520857-67dc-4a18-8b24-ccfb12e7efb4 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.11 "DELETE /v2.0/ports/5172ee0c-ea3e-44e9-b520-47bb5c4ea808 HTTP/1.1" status: 204 len: 173 time: 0.8187430 Nov 11 14:36:28.489602 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'name': 'network-vif-deleted', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:36:28.491865 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e3b02a4-c37d-4169-9fdb-907996fec7f5" -d '{"events": [{"server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "name": "network-vif-deleted", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:36:28.534363 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:36:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-791e4ba4-356f-4a01-b209-f75440e12c68 x-openstack-request-id: req-791e4ba4-356f-4a01-b209-f75440e12c68 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:36:28.534657 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9ca35464-2a74-4e5c-8576-57b0dde713db", "name": "network-vif-deleted", "tag": "5172ee0c-ea3e-44e9-b520-47bb5c4ea808", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:36:28.534909 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-791e4ba4-356f-4a01-b209-f75440e12c68 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:36:28.536084 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9ca35464-2a74-4e5c-8576-57b0dde713db', 'name': 'network-vif-deleted', 'tag': '5172ee0c-ea3e-44e9-b520-47bb5c4ea808', 'status': 'completed', 'code': 200} Nov 11 14:36:28.573123 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:36:28.780192 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:28.806670 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:36:28.814629 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:36:28.815191 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:36:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:28.916937 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:36:29.193234 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:29.219214 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc0334a-ef07-4d74-a397-2333e68e8190 None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:13Z', 'revision_number': 4, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi', '_interfaces': [{'id': 'b8bbbd88-6455-4786-a740-e30545812074', 'name': '', 'network_id': 'c7053be2-46f8-424c-a8b5-3cba0c2fb790', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'mac_address': 'fa:16:3e:90:37:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:12Z', 'updated_at': '2021-11-11T14:32:16Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'subnets': [{'id': 'b823154a-6f60-4185-ba89-f69641669a9e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:36:29.406841 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-6cec1666-fc3a-4606-8514-88da9567b56c req-1875a78f-8573-4f95-9dd6-efe787a39b01 tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/ports?device_id=9ca35464-2a74-4e5c-8576-57b0dde713db HTTP/1.1" status: 200 len: 210 time: 0.0266511 Nov 11 14:36:29.443967 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-526a6335-510f-49fa-b574-1897e00d21bd None None] New status for floating IP 838aceff-139b-4089-890f-c7d1e3b32494: DOWN {{(pid=102269) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 11 14:36:30.245595 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:36:30.265744 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:36:30.266077 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 5172ee0c-ea3e-44e9-b520-47bb5c4ea808 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:36:30.550643 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39414) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:30.602898 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.629609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.756188 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.758665 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.759820 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "DELETE /v2.0/security-groups/9f3341e5-9344-4fd3-8ab7-d02f8723c3bb HTTP/1.1" status: 204 len: 168 time: 0.2081788 Nov 11 14:36:30.762876 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39416) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:30.769091 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f3341e5-9344-4fd3-8ab7-d02f8723c3bb,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:30.776626 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.api.v2.resource [None req-0f673e55-adb6-4053-9c4f-11149c96f7ff tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] show failed (client error): The resource could not be found. Nov 11 14:36:30.783509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783509 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783842 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0f673e55-adb6-4053-9c4f-11149c96f7ff tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "GET /v2.0/security-groups/9f3341e5-9344-4fd3-8ab7-d02f8723c3bb HTTP/1.1" status: 404 len: 347 time: 0.0136950 Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.783958 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8209fd44-1b58-412b-9e9d-8a8cf101627f tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:30.784749 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39418) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:30.904374 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Deleting port c7844781-46a3-48a2-8723-c6d305fb0814 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:30.904709 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.979508 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.979817 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:30.991061 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Calling delete_port for c7844781-46a3-48a2-8723-c6d305fb0814 owned by network:floatingip {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:31.259309 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:31.282740 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Pushing event deleted for resources: {'Port': ['ID=c7844781-46a3-48a2-8723-c6d305fb0814,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:31.342832 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks [] for floatingip, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:31.345454 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for floatingip, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:31.346573 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-019f1b21-0426-4e22-8553-cda37c4bd8ca tempest-AttachVolumeTestJSON-413759196 tempest-AttachVolumeTestJSON-413759196-project] 10.222.0.10 "DELETE /v2.0/floatingips/838aceff-139b-4089-890f-c7d1e3b32494 HTTP/1.1" status: 204 len: 168 time: 0.5620301 Nov 11 14:36:35.307706 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39446) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:35.637639 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-395250'] for router_interface, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:35.876966 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Deleting port b8bbbd88-6455-4786-a740-e30545812074 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:35.877402 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:35.952990 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] For port b8bbbd88-6455-4786-a740-e30545812074, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=b8bbbd88-6455-4786-a740-e30545812074,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:36:35.953380 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:35.966425 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Calling delete_port for b8bbbd88-6455-4786-a740-e30545812074 owned by network:router_interface {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:36.050355 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-583085cc-596e-41bb-bb8e-bc9646bead24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:36.193641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:36.223416 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Pushing event deleted for resources: {'Port': ['ID=b8bbbd88-6455-4786-a740-e30545812074,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:36.381404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3696480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-394850'] for router_interface, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:36.835165 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Router 036f804a-de67-4309-b1fe-776c98e1bbc4 has already been hosted by L3 agent b13e4b14-a574-4cac-aadd-205be1453193 {{(pid=102267) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 11 14:36:36.936034 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] Notify agent at l3_agent.dv-cinder-777031-9-iscsi the message routers_updated {{(pid=102267) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 11 14:36:36.941009 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-74f24dfd-980f-482f-afe1-0cc671129dd7 admin admin] 10.222.0.10 "PUT /v2.0/routers/036f804a-de67-4309-b1fe-776c98e1bbc4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6322420 Nov 11 14:36:36.943687 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39448) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:36.947054 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Sync routers for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 11 14:36:36.956725 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:36:36.957306 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:36:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:37.046335 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks [] for router, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.057479 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: dv-cinder-777031-9-iscsi {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:36:37.144860 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.228730 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'external_fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22'}], 'enable_snat': True}, 'gw_port_id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:36:36Z', 'revision_number': 5, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port': {'id': '96417568-9e93-4dc3-ada5-85dd4d6ea2f9', 'name': '', 'network_id': '2695a271-995b-4caa-b664-bb0645c2bc02', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:70:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'ip_address': '172.27.1.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-777031-9-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:32:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '872490fe-8b51-42ad-a4a2-14f82622d8e6', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-777031-9-iscsi'}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:37.253910 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Checking router: 036f804a-de67-4309-b1fe-776c98e1bbc4 for host: dv-cinder-777031-9-iscsi {{(pid=102270) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 11 14:36:37.259003 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Deleting port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:37.259339 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.262207 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Routers {'036f804a-de67-4309-b1fe-776c98e1bbc4'} bound to L3 agent in host dv-cinder-777031-9-iscsi {{(pid=102270) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 11 14:36:37.262792 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-777031-9-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-11T14:15:08Z,description=,heartbeat_timestamp=2021-11-11T14:36:08Z,host='dv-cinder-777031-9-iscsi',id=b13e4b14-a574-4cac-aadd-205be1453193,load=0,resource_versions=,resources_synced=,started_at=2021-11-11T14:15:09Z,topic='l3_agent')) {'router_ids': ['036f804a-de67-4309-b1fe-776c98e1bbc4'], 'active': True} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:37.337312 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] For port 96417568-9e93-4dc3-ada5-85dd4d6ea2f9, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,segment=NetworkSegment(ccf60016-3240-46fc-a3a3-4c5e7de68220),segment_id=ccf60016-3240-46fc-a3a3-4c5e7de68220)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:36:37.337581 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.349924 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_dvr_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] Set router 036f804a-de67-4309-b1fe-776c98e1bbc4 gateway port host: None {{(pid=102270) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 11 14:36:37.350502 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Calling delete_port for 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 owned by network:router_gateway {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:37.404000 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.l3_hamode_db [None req-a83114ec-8498-431f-b584-28709e0989cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:36:37Z', 'revision_number': 6, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port_host': None}], 'dv-cinder-777031-9-iscsi', False) {} {{(pid=102270) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:37.430095 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83114ec-8498-431f-b584-28709e0989cc None None] The sync data for ids ['036f804a-de67-4309-b1fe-776c98e1bbc4'] in dv-cinder-777031-9-iscsi is: [{'id': '036f804a-de67-4309-b1fe-776c98e1bbc4', 'name': 'tempest-AttachVolumeTestJSON-1137613373-router', 'tenant_id': '1dfdd8159d1f45c99f739dea5093090b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-11T14:32:10Z', 'updated_at': '2021-11-11T14:36:37Z', 'revision_number': 6, 'project_id': '1dfdd8159d1f45c99f739dea5093090b', 'gw_port_host': None}] {{(pid=102270) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 11 14:36:37.575821 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.600857 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Pushing event deleted for resources: {'Port': ['ID=96417568-9e93-4dc3-ada5-85dd4d6ea2f9,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:37.661776 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-393864'] for router_gateway, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.748671 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-396831', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-41396'] for router, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.750652 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.876339 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-396820'] for router, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.876873 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 036f804a-de67-4309-b1fe-776c98e1bbc4 {{(pid=102267) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 11 14:36:37.881711 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] Publish callbacks [] for router, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.882833 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-596110fb-ec27-43ae-b76f-60be5ec82140 admin admin] 10.222.0.10 "DELETE /v2.0/routers/036f804a-de67-4309-b1fe-776c98e1bbc4 HTTP/1.1" status: 204 len: 168 time: 0.9375069 Nov 11 14:36:37.885604 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39450) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:37.932942 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Deleting subnet b823154a-6f60-4185-ba89-f69641669a9e {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:36:37.935907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:37.968912 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.041769 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.153685 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.182246 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b823154a-6f60-4185-ba89-f69641669a9e,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:38.188210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.191820 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-6868e9ad-1a49-4216-82b0-e8f931d2c7f2 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/b823154a-6f60-4185-ba89-f69641669a9e HTTP/1.1" status: 204 len: 168 time: 0.3051271 Nov 11 14:36:38.194972 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f45d6880-d94e-4f59-aaf5-aca0fe4984fc None None] Network c7053be2-46f8-424c-a8b5-3cba0c2fb790 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:36:38.195522 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39452) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:38.264796 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.318727 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Deleting port eced97f4-5f54-4c65-aae6-d3366be42455 {{(pid=102268) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:38.319066 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.379513 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] DHCP port deletion for c7053be2-46f8-424c-a8b5-3cba0c2fb790 request from dv-cinder-777031-9-iscsi {{(pid=102269) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 11 14:36:38.392911 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.db [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] For port eced97f4-5f54-4c65-aae6-d3366be42455, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=eced97f4-5f54-4c65-aae6-d3366be42455,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102268) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:36:38.393272 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.406794 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.plugin [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Calling delete_port for eced97f4-5f54-4c65-aae6-d3366be42455 owned by network:dhcp {{(pid=102268) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:38.444502 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Deleting port eced97f4-5f54-4c65-aae6-d3366be42455 {{(pid=102269) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:36:38.444796 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.497072 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-4312dbec-68f4-40b8-9cb7-ef3e5907740b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.518689 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] For port eced97f4-5f54-4c65-aae6-d3366be42455, host dv-cinder-777031-9-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-777031-9-iscsi',level=0,port_id=eced97f4-5f54-4c65-aae6-d3366be42455,segment=NetworkSegment(67956f27-c765-49dd-8650-765667d8ca05),segment_id=67956f27-c765-49dd-8650-765667d8ca05)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:36:38.519082 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.531912 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Calling delete_port for eced97f4-5f54-4c65-aae6-d3366be42455 owned by network:dhcp {{(pid=102269) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:36:38.574014 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b8bbbd88-6455-4786-a740-e30545812074 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:36:38.574308 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-125906261'] for port, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.595295 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: b8bbbd88-6455-4786-a740-e30545812074 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:36:38.595650 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device b8bbbd88-6455-4786-a740-e30545812074 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:36:38.596065 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device eced97f4-5f54-4c65-aae6-d3366be42455 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:36:38.603892 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Pushing event deleted for resources: {'Port': ['ID=eced97f4-5f54-4c65-aae6-d3366be42455,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:38.607155 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] No DVR routers for this DVR port eced97f4-5f54-4c65-aae6-d3366be42455 on host dv-cinder-777031-9-iscsi {{(pid=102268) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:36:38.629932 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: eced97f4-5f54-4c65-aae6-d3366be42455 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:36:38.630289 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device eced97f4-5f54-4c65-aae6-d3366be42455 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:36:38.631044 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 no longer exists at agent ovs-agent-dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:36:38.661660 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] No Port match for: 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:36:38.662003 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Device 96417568-9e93-4dc3-ada5-85dd4d6ea2f9 not bound to the agent host dv-cinder-777031-9-iscsi {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:36:38.678886 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881'] for port, after_delete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.680382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.699832 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c7053be2-46f8-424c-a8b5-3cba0c2fb790']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:38.703500 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Pushing event deleted for resources: {'Port': ['ID=eced97f4-5f54-4c65-aae6-d3366be42455,revision_number=None']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:38.709395 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '67956f27-c765-49dd-8650-765667d8ca05') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:38.709687 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '67956f27-c765-49dd-8650-765667d8ca05') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:36:38.711176 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] No DVR routers for this DVR port eced97f4-5f54-4c65-aae6-d3366be42455 on host dv-cinder-777031-9-iscsi {{(pid=102269) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:36:38.713435 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.716599 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.717424 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.717424 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6bb546f7-08e4-4e33-9801-a0bc2d82525c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:36:38.724000 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.737123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.743197 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Releasing vlan 319 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:36:38.743601 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:36:38.745210 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:36:38.867067 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.871382 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:38.874621 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] 10.222.0.10 "DELETE /v2.0/networks/c7053be2-46f8-424c-a8b5-3cba0c2fb790 HTTP/1.1" status: 204 len: 168 time: 0.6785412 Nov 11 14:36:38.887503 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d45fd1a-a15b-49f3-80aa-b52dbb7cba6f admin admin] Pushing event deleted for resources: {'Network': ['ID=c7053be2-46f8-424c-a8b5-3cba0c2fb790,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:39.289016 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39456) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:39.328037 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-aab6aaff-895f-4506-ba89-935ac86dec19 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=1dfdd8159d1f45c99f739dea5093090b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0378962 Nov 11 14:36:39.330323 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39458) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:39.375908 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:39.398010 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:39.495463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:39.498015 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:39.499255 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/7c47264f-d3c5-41b4-9847-bf2feeb222d4 HTTP/1.1" status: 204 len: 168 time: 0.1679344 Nov 11 14:36:39.507853 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e17afae2-6640-48bd-b9af-3814a0b50848 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c47264f-d3c5-41b4-9847-bf2feeb222d4,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:39.658680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:40.814800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:41.744721 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.176027 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.570027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39520) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:42.692856 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0aea7cec-0fc4-4924-90c8-ffe1fa22b377 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.763978 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0aea7cec-0fc4-4924-90c8-ffe1fa22b377 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.841489 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0aea7cec-0fc4-4924-90c8-ffe1fa22b377 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.882528 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0aea7cec-0fc4-4924-90c8-ffe1fa22b377 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=6973f18b57cf4ea19d781659a5895bff&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3114562 Nov 11 14:36:42.883424 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aea7cec-0fc4-4924-90c8-ffe1fa22b377 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b68a1e31-dd96-441f-afde-e8f3a819e148,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:42.885545 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39524) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:42.933690 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:42.954088 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.075635 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.078187 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.079308 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/b68a1e31-dd96-441f-afde-e8f3a819e148 HTTP/1.1" status: 204 len: 168 time: 0.1927943 Nov 11 14:36:43.087471 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52a4e50-0178-427b-94ee-8f8d58160045 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b68a1e31-dd96-441f-afde-e8f3a819e148,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:43.667182 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39530) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:43.680953 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b7866669-6836-4908-90ae-2ffd3c41cc7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.756618 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b7866669-6836-4908-90ae-2ffd3c41cc7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.838503 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b7866669-6836-4908-90ae-2ffd3c41cc7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.877349 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b7866669-6836-4908-90ae-2ffd3c41cc7a admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=0f4106db40904d2999bbd75c0d7d99aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2090373 Nov 11 14:36:43.878214 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7866669-6836-4908-90ae-2ffd3c41cc7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dadc27d0-76d2-4274-9f0a-2fd0015034d9,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:43.880033 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39532) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:43.929111 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:43.949342 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:44.073055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:44.075696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:44.076847 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/dadc27d0-76d2-4274-9f0a-2fd0015034d9 HTTP/1.1" status: 204 len: 168 time: 0.1956830 Nov 11 14:36:44.085981 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-896fdb3e-6e97-42b1-ae61-6f09eb5e1601 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dadc27d0-76d2-4274-9f0a-2fd0015034d9,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:45.109121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39554) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:45.203574 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-569837611-network', 'tenant_id': '226b15232844475ca30641bea8e70448'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:36:45.278461 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Made reservation on behalf of 226b15232844475ca30641bea8e70448 for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:36:45.280859 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.289851 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.361745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.430292 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.454974 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 345} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:36:45.463932 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0355962d-6650-4401-8b49-2047a2674a2c,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:45.469561 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.469951 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Added segment 387d693b-cc9c-4cac-a5a4-93c2ec8b21fa of type vlan for network 1a886890-e7a0-42c3-8f3b-af09bac5fb34 Nov 11 14:36:45.510816 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.644231 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.645189 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:45.645792 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:45.751646 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] Pushing event updated for resources: {'Network': ['ID=1a886890-e7a0-42c3-8f3b-af09bac5fb34,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:45.762150 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network 1a886890-e7a0-42c3-8f3b-af09bac5fb34 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:36:45.783844 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-0ba1a4b0-686e-4e1d-ae4f-5122137ecfe7 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6735382 Nov 11 14:36:45.786772 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39558) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:45.791519 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Request body: {'subnet': {'network_id': '1a886890-e7a0-42c3-8f3b-af09bac5fb34', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-569837611-subnet', 'tenant_id': '226b15232844475ca30641bea8e70448', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:36:45.881959 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Made reservation on behalf of 226b15232844475ca30641bea8e70448 for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:36:45.884380 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:46.101774 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:46.161350 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Pushing event updated for resources: {'Subnet': ['ID=06f65db7-1aa2-4cf4-b281-6ed60ae5dc7a,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:46.169177 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Checking segment: {'id': '387d693b-cc9c-4cac-a5a4-93c2ec8b21fa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 345, 'network_id': '1a886890-e7a0-42c3-8f3b-af09bac5fb34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:36:46.169531 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Network hostable DHCP agents. Network: 1a886890-e7a0-42c3-8f3b-af09bac5fb34, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:36:46.266716 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Network 1a886890-e7a0-42c3-8f3b-af09bac5fb34 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:36:46.336921 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, 1a886890-e7a0-42c3-8f3b-af09bac5fb34) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:36:46.340983 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:46.341575 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:46.346088 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8c3831d-2aad-4561-b7d5-34d45f0ca11f None None] Network 1a886890-e7a0-42c3-8f3b-af09bac5fb34 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:36:46.430966 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-89e0f54e-c1d6-4cf3-b633-2dfe0ebb5f66 admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6430473 Nov 11 14:36:46.618222 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-785e98e8-910c-44a3-8c76-9c9c17e54822 None None] Network 1a886890-e7a0-42c3-8f3b-af09bac5fb34 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:36:47.156283 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39574) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:47.161140 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1953687229-network', 'tenant_id': 'ec26de71f22e4382bc0d18d2d4b6597b'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:36:47.241625 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Made reservation on behalf of ec26de71f22e4382bc0d18d2d4b6597b for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:36:47.243786 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.252188 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.322628 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.390451 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.411482 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 332} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:36:47.424411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=685ab10d-3559-409d-b867-feb6342cc8cb,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:47.429046 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.429407 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Added segment 65a8f5f1-570b-43b4-a3f1-7a73a68713a2 of type vlan for network d7551c71-720d-499d-999f-f2e92bc5a749 Nov 11 14:36:47.468722 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.561891 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.562778 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:47.563433 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:47.626379 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] Pushing event updated for resources: {'Network': ['ID=d7551c71-720d-499d-999f-f2e92bc5a749,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:47.636322 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network d7551c71-720d-499d-999f-f2e92bc5a749 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:36:47.690286 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-295e2c71-288f-4cc1-8efb-8ba62098e481 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5328670 Nov 11 14:36:47.699105 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39580) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:36:47.704134 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.v2.base [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Request body: {'subnet': {'network_id': 'd7551c71-720d-499d-999f-f2e92bc5a749', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1953687229-subnet', 'tenant_id': 'ec26de71f22e4382bc0d18d2d4b6597b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102268) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:36:47.781066 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Made reservation on behalf of ec26de71f22e4382bc0d18d2d4b6597b for: {'subnet': 1} {{(pid=102268) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:36:47.783557 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-129288590'] for subnet, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:48.018863 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-125906361', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-129288608'] for subnet, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:48.072704 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=a339b001-f560-4012-87f0-bbab86714221,revision_number=0']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:36:48.080997 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Checking segment: {'id': '65a8f5f1-570b-43b4-a3f1-7a73a68713a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 332, 'network_id': 'd7551c71-720d-499d-999f-f2e92bc5a749'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102268) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:36:48.081343 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Network hostable DHCP agents. Network: d7551c71-720d-499d-999f-f2e92bc5a749, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102268) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:36:48.164123 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Network d7551c71-720d-499d-999f-f2e92bc5a749 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102268) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:36:48.210157 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.scheduler.base_scheduler [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, d7551c71-720d-499d-999f-f2e92bc5a749) {{(pid=102268) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:36:48.213950 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:36:48.214530 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:36:48.220140 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b38cfead-a57d-42ef-892e-082f91c83e13 None None] Network d7551c71-720d-499d-999f-f2e92bc5a749 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:36:48.273292 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-00892a2f-6840-4aec-b13d-7e3433a27b9d admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5730362 Nov 11 14:36:48.342639 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7512e67f-7584-4765-92cb-e7f36c5c3d1f None None] Network d7551c71-720d-499d-999f-f2e92bc5a749 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:36:59.341649 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:37:04.316467 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39706) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:04.366295 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.db.db_base_plugin_v2 [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Deleting subnet 06f65db7-1aa2-4cf4-b281-6ed60ae5dc7a {{(pid=102268) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:37:04.369891 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.403502 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-129741504'] for subnet, precommit_delete_associations {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.441141 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.552739 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-125906296', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-129288619'] for subnet, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.581710 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06f65db7-1aa2-4cf4-b281-6ed60ae5dc7a,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:04.585340 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.588558 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1274822e-f284-4be9-9509-e192d081d2b6 admin admin] 10.222.0.10 "DELETE /v2.0/subnets/06f65db7-1aa2-4cf4-b281-6ed60ae5dc7a HTTP/1.1" status: 204 len: 168 time: 0.2710590 Nov 11 14:37:04.591047 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39708) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:04.657849 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.739574 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.763478 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1a886890-e7a0-42c3-8f3b-af09bac5fb34']}} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:04.772415 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '387d693b-cc9c-4cac-a5a4-93c2ec8b21fa') {'for_net_delete': True} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:04.772705 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.services.segments.db [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '387d693b-cc9c-4cac-a5a4-93c2ec8b21fa') {} {{(pid=102268) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:04.782304 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-129741529'] for segment, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.795510 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.801127 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Releasing vlan 345 on physical network physnet1 to pool {{(pid=102268) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:37:04.802464 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-125906214'] for segment, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: Traceback (most recent call last): Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: timer() Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: cb(*args, **kw) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: return func(*args, **kwargs) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: self._notify() Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: self.callback(batched_events) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: event.method(event) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: return f(self, *a, **k) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._get(url).json() Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: return self.request(url, 'GET', **kwargs) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:37:04.803064 dv-cinder-777031-9-iscsi neutron-server[102268]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:37:04.918445 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.924013 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:04.927183 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] 10.222.0.10 "DELETE /v2.0/networks/1a886890-e7a0-42c3-8f3b-af09bac5fb34 HTTP/1.1" status: 204 len: 168 time: 0.3351986 Nov 11 14:37:04.930148 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39710) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:04.937703 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b969cac7-8ef0-47a6-9d2d-3b1e7d787aa0 admin admin] Pushing event deleted for resources: {'Network': ['ID=1a886890-e7a0-42c3-8f3b-af09bac5fb34,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:04.975874 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Deleting subnet a339b001-f560-4012-87f0-bbab86714221 {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:37:04.979684 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.013868 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.052232 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.158317 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.181594 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a339b001-f560-4012-87f0-bbab86714221,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:05.187911 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.191171 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-1100919c-c73c-4523-97dc-4d2371f3061d admin admin] 10.222.0.10 "DELETE /v2.0/subnets/a339b001-f560-4012-87f0-bbab86714221 HTTP/1.1" status: 204 len: 168 time: 0.2600136 Nov 11 14:37:05.193641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39712) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:05.258815 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.339394 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.358567 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d7551c71-720d-499d-999f-f2e92bc5a749']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:05.367513 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65a8f5f1-570b-43b4-a3f1-7a73a68713a2') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:05.367812 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65a8f5f1-570b-43b4-a3f1-7a73a68713a2') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:37:05.376863 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.390136 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.398076 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Releasing vlan 332 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:37:05.398456 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:37:05.400706 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:37:05.535459 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.540742 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:05.543958 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] 10.222.0.10 "DELETE /v2.0/networks/d7551c71-720d-499d-999f-f2e92bc5a749 HTTP/1.1" status: 204 len: 168 time: 0.3494067 Nov 11 14:37:05.554453 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01feb9a9-ecce-451f-9d20-4703973c3c27 admin admin] Pushing event deleted for resources: {'Network': ['ID=d7551c71-720d-499d-999f-f2e92bc5a749,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:05.909677 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39716) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:05.952765 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-fe235a8a-d393-4030-bca2-fa0e6ecd5f20 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=226b15232844475ca30641bea8e70448&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0419464 Nov 11 14:37:05.955147 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39718) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:06.002691 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.023175 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.047098 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ab53d78e-ea7a-4d37-a7c4-27c2e6e67380 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.132823 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.136211 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.137356 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/0355962d-6650-4401-8b49-2047a2674a2c HTTP/1.1" status: 204 len: 168 time: 0.1813052 Nov 11 14:37:06.144952 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f25cdfe-f216-4330-b492-bbc2f0743354 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0355962d-6650-4401-8b49-2047a2674a2c,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:06.755198 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39724) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:06.794999 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-79c20ca8-8810-4bd6-bc1a-ee6eee7c8d66 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=ec26de71f22e4382bc0d18d2d4b6597b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0386159 Nov 11 14:37:06.797419 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39726) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:06.843377 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.863309 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.972825 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.975421 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:06.976546 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/685ab10d-3559-409d-b867-feb6342cc8cb HTTP/1.1" status: 204 len: 168 time: 0.1782515 Nov 11 14:37:06.984124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cba8e0d-3678-46e2-8e3b-8a42c8e91a14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=685ab10d-3559-409d-b867-feb6342cc8cb,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:08.466704 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b4202435-a03d-4a3f-8a7c-0c9990a58848 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:09.695700 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:10.775689 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:11.740693 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.181119 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.318810 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 39792) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:12.420237 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c64eeac-8771-4f3f-b118-29d6bf472c30 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.490756 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c64eeac-8771-4f3f-b118-29d6bf472c30 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.551915 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9c64eeac-8771-4f3f-b118-29d6bf472c30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.589839 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9c64eeac-8771-4f3f-b118-29d6bf472c30 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=7910abde7710499584ed820434443822&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2699156 Nov 11 14:37:12.590703 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c64eeac-8771-4f3f-b118-29d6bf472c30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bec25b7-a785-48ed-8cfd-82e700cce7b2,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:12.593270 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39796) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:12.640680 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.661809 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.795958 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.798649 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:12.799859 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/4bec25b7-a785-48ed-8cfd-82e700cce7b2 HTTP/1.1" status: 204 len: 168 time: 0.2056153 Nov 11 14:37:12.807649 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700d95cb-0ac9-4f31-8230-a0e3b039a310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bec25b7-a785-48ed-8cfd-82e700cce7b2,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:13.738211 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39818) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:13.836626 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-989541554-network', 'tenant_id': '869a2ebce51e4a1b8e021e489e00702d'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:13.935666 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Made reservation on behalf of 869a2ebce51e4a1b8e021e489e00702d for: {'network': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:37:13.938019 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for network, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:13.946389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.019185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.095215 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.120161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 309} {{(pid=102267) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 11 14:37:14.130643 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae457fdc-11fe-40c5-aa0e-af2e29be9c80,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:14.135580 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.135934 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.db.segments_db [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Added segment 88c1937a-5ea1-45cd-a17a-e589f410bf29 of type vlan for network b4612dd8-1b77-44d3-96dc-147541870170 Nov 11 14:37:14.177080 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8764490535626'] for network, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.255011 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539'] for network, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.256005 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:14.256630 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.313603 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] Pushing event updated for resources: {'Network': ['ID=b4612dd8-1b77-44d3-96dc-147541870170,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:14.323096 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Network b4612dd8-1b77-44d3-96dc-147541870170 details requested by agent ovs-agent-dv-cinder-777031-9-iscsi with host dv-cinder-777031-9-iscsi {{(pid=102269) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 11 14:37:14.349148 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-90bd3f89-c92d-4c7d-98b0-a41e179db2f2 admin admin] 10.222.0.10 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6097505 Nov 11 14:37:14.352036 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 39822) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:37:14.357200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Request body: {'subnet': {'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-989541554-subnet', 'tenant_id': '869a2ebce51e4a1b8e021e489e00702d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:14.472376 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Made reservation on behalf of 869a2ebce51e4a1b8e021e489e00702d for: {'subnet': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:37:14.474738 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-127257106'] for subnet, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.701140 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126445317', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-127257148'] for subnet, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.761397 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Pushing event updated for resources: {'Subnet': ['ID=37f81eb6-175a-491e-8ad1-43747142ec69,revision_number=0']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:14.777062 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Checking segment: {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:37:14.777418 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Network hostable DHCP agents. Network: b4612dd8-1b77-44d3-96dc-147541870170, hostable agents: ['9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2'], hosted agents: [] {{(pid=102267) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 11 14:37:14.848965 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Network b4612dd8-1b77-44d3-96dc-147541870170 is scheduled to be hosted by DHCP agent 9f52846e-1c7d-4dd5-bf47-8f17aa56a2d2 with binding_index 1 {{(pid=102267) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 11 14:37:14.912400 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-777031-9-iscsi, b4612dd8-1b77-44d3-96dc-147541870170) {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:37:14.916639 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:14.917183 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:14.921208 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-872f4024-5f29-4354-a392-6f7921d96fdd None None] Network b4612dd8-1b77-44d3-96dc-147541870170 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:37:14.995581 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-a56a0012-076e-4add-8218-4706c4cf575e admin admin] 10.222.0.10 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6423731 Nov 11 14:37:15.035652 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0572b60c-a4ff-4513-aa69-5ae9032e5f4f None None] Network b4612dd8-1b77-44d3-96dc-147541870170 requested from dv-cinder-777031-9-iscsi {{(pid=102269) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 11 14:37:17.090084 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-987e0d2f-e6f3-4364-b8b1-5d162527cfae tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:17.091544 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-987e0d2f-e6f3-4364-b8b1-5d162527cfae tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/networks?id=b4612dd8-1b77-44d3-96dc-147541870170 HTTP/1.1" status: 200 len: 808 time: 0.0984862 Nov 11 14:37:17.105666 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e0b89124-5db7-493a-a53c-add73fc317c5 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/quotas/869a2ebce51e4a1b8e021e489e00702d HTTP/1.1" status: 200 len: 375 time: 0.0086026 Nov 11 14:37:17.145961 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-490b8870-aa9e-46e9-8d1f-ba45c8954bf9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0347984 Nov 11 14:37:17.274362 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-ce7045a6-7902-45df-bbd0-96d0497dbb8d service neutron] 10.222.0.10 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1215255 Nov 11 14:37:17.364409 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-94dd6025-82cf-413c-87cc-d7de7f56d080 service neutron] 10.222.0.10 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839272 Nov 11 14:37:17.609776 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-b390b622-2794-4b9c-bbb5-e54878512622 req-60747f34-6bbb-4fce-afad-57187dd829fe tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 210 time: 0.0271454 Nov 11 14:37:18.701787 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-994d2aa2-1e3c-436d-85ef-5dfee0519628 req-d794221b-aed8-4922-a6e6-51fa6abd108d tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 210 time: 0.0267599 Nov 11 14:37:19.537324 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-8a844fc1-9f75-47b3-9a5c-ce4ce1954cb9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:19.538744 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-8a844fc1-9f75-47b3-9a5c-ce4ce1954cb9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "GET /v2.0/networks?id=b4612dd8-1b77-44d3-96dc-147541870170 HTTP/1.1" status: 200 len: 808 time: 0.0984008 Nov 11 14:37:19.551498 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Request body: {'port': {'device_id': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170', 'admin_state_up': True, 'tenant_id': '869a2ebce51e4a1b8e021e489e00702d'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:19.716185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Made reservation on behalf of 869a2ebce51e4a1b8e021e489e00702d for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:37:19.719872 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:19.804262 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-714d94d8-3efa-43a9-816c-bf2135488429 req-e816530c-7b1c-476b-b1ef-a6304565edd5 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 210 time: 0.0270758 Nov 11 14:37:19.852429 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Allocated IP 172.20.0.7 (b4612dd8-1b77-44d3-96dc-147541870170/37f81eb6-175a-491e-8ad1-43747142ec69/a0d6d2b8-496f-40e2-96ac-7e50a2818cd6) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:37:19.993217 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.081353 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.125471 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Network b4612dd8-1b77-44d3-96dc-147541870170 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:37:20.130504 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:37:20.134185 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:37:20.141939 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Pushing event updated for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:20.187031 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:20.187655 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.272289 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-656a0069-31be-41a7-bea5-4d5df3c43f0c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7245591 Nov 11 14:37:20.284744 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Request body: {'port': {'device_id': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:20.339889 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.586347 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:37:20.594288 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.605834 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Transition to ACTIVE for port object a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:37:20.675255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.724696 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Pushing event updated for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:20.804944 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Attempting to bind port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:37:20.805268 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Attempting to bind port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:37:20.805589 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Attempting to bind port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 on network b4612dd8-1b77-44d3-96dc-147541870170 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:37:20.809779 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 on network b4612dd8-1b77-44d3-96dc-147541870170 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:37:20.810091 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Attempting to bind port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 on network b4612dd8-1b77-44d3-96dc-147541870170 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:37:20.814870 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:37:20.815199 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Checking segment: {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:37:20.815608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Bound using segment: {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:37:20.816027 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Bound port: a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:37:20.816373 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:20.886694 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:37:20.913492 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:37:20.931058 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cd603d-4d6d-49a9-9e5e-234dbdd88550 req-51068513-2ab2-49d4-ae02-efd5d3230e43 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:20.932546 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-03cd603d-4d6d-49a9-9e5e-234dbdd88550 req-51068513-2ab2-49d4-ae02-efd5d3230e43 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 943 time: 0.0600262 Nov 11 14:37:20.972403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:21.007987 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-03cd603d-4d6d-49a9-9e5e-234dbdd88550 req-3f3ca157-d36e-4523-a00a-09d65704e9f7 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695319 Nov 11 14:37:21.015477 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.016104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:21.017427 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] 10.222.0.11 "PUT /v2.0/ports/a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 HTTP/1.1" status: 200 len: 1093 time: 0.7366474 Nov 11 14:37:21.017862 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:21.020186 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-198ff7a3-ee31-490d-b27d-3dbc245f22b3" -d '{"events": [{"name": "network-changed", "server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:21.043386 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d0f936-d862-424a-9fc2-6a3ae73d7809 service neutron] Pushing event updated for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:21.058026 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49639aa2-bd9f-4268-8084-dfe00c762384 x-openstack-request-id: req-49639aa2-bd9f-4268-8084-dfe00c762384 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:21.058309 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:21.058557 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-49639aa2-bd9f-4268-8084-dfe00c762384 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:21.058944 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6', 'status': 'completed', 'code': 200} Nov 11 14:37:21.120721 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-69d4f8fa-6172-459a-b349-a79b6ee2cd1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.122284 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-69d4f8fa-6172-459a-b349-a79b6ee2cd1d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 1096 time: 0.0404980 Nov 11 14:37:21.218540 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-1cb2c228-0d71-4cc7-b9e4-72b03db9e4b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.220025 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-1cb2c228-0d71-4cc7-b9e4-72b03db9e4b6 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=869a2ebce51e4a1b8e021e489e00702d&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0899739 Nov 11 14:37:21.318055 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-9db572bf-e3f1-4601-8353-3be91cc1f917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.319577 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-198ff7a3-ee31-490d-b27d-3dbc245f22b3 req-9db572bf-e3f1-4601-8353-3be91cc1f917 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0919101 Nov 11 14:37:21.392232 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-bb3b3634-f794-4368-b3c1-081895093763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.393656 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-bb3b3634-f794-4368-b3c1-081895093763 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 1096 time: 0.0392275 Nov 11 14:37:21.447014 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-de38789d-ae36-4274-a3c0-d6f890346b18 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 HTTP/1.1" status: 200 len: 217 time: 0.0387626 Nov 11 14:37:21.496570 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-54b6b2f5-8df4-4577-abda-9db8b5924ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:21.497916 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-54b6b2f5-8df4-4577-abda-9db8b5924ef6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=37f81eb6-175a-491e-8ad1-43747142ec69 HTTP/1.1" status: 200 len: 848 time: 0.0443037 Nov 11 14:37:21.529923 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-6ecbbbdb-d3cb-4f43-b3b2-ac96f91b64fc service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b4612dd8-1b77-44d3-96dc-147541870170&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0243855 Nov 11 14:37:21.619257 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-67728c67-818a-41b2-b377-6d951d0575af service neutron] 10.222.0.11 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827298 Nov 11 14:37:21.949099 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-56057d56-b591-4d2f-956c-c799dfb8cafd req-40af2d57-d6e0-4e69-8efd-895d85fd4ea4 service neutron] 10.222.0.11 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3207080 Nov 11 14:37:22.124064 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cc131d-c822-44e9-bb65-f4bba4dd8309 req-582c7c02-55be-4aab-ae78-a49c9b45902a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:22.125567 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-29cc131d-c822-44e9-bb65-f4bba4dd8309 req-582c7c02-55be-4aab-ae78-a49c9b45902a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 943 time: 0.0485897 Nov 11 14:37:22.175331 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-29cc131d-c822-44e9-bb65-f4bba4dd8309 req-c17fdea8-9dd2-4301-80b2-600989e66b08 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431564 Nov 11 14:37:23.292446 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa184d9-42cd-4b4b-b9ed-8e6e7b4f22e8 req-a6bb6f42-9f03-4af7-af48-35c246593d1e tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:23.293889 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0aa184d9-42cd-4b4b-b9ed-8e6e7b4f22e8 req-a6bb6f42-9f03-4af7-af48-35c246593d1e tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 943 time: 0.0509229 Nov 11 14:37:23.339018 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0aa184d9-42cd-4b4b-b9ed-8e6e7b4f22e8 req-2cfcdc5e-4b26-4ab0-be8c-ce68618f8d08 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394061 Nov 11 14:37:24.449616 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7efaf17b-20ee-43b0-9e64-4da2e78eac94 req-05b632ca-a273-41d5-a1b9-914bcf0ca932 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:24.451078 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7efaf17b-20ee-43b0-9e64-4da2e78eac94 req-05b632ca-a273-41d5-a1b9-914bcf0ca932 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 943 time: 0.0470371 Nov 11 14:37:24.496769 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-7efaf17b-20ee-43b0-9e64-4da2e78eac94 req-8829c207-cfab-4e16-b2c4-29b696459fc9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399036 Nov 11 14:37:24.587779 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:37:24.679191 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:24.689757 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6', 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170', 'port_id': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6', 'mac_address': 'fa:16:3e:e4:46:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 309, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37f81eb6-175a-491e-8ad1-43747142ec69', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:37:24.729381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:24.741198 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:37:24.759038 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:24.852631 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:24.898849 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:25.062512 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['a0d6d2b8-496f-40e2-96ac-7e50a2818cd6'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:37:25.608287 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69b4bb4-1364-4eef-ad02-ba8162da7fc0 req-cf0c99aa-4bed-4fa0-934e-6e351ce2b2ca tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:25.609756 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f69b4bb4-1364-4eef-ad02-ba8162da7fc0 req-cf0c99aa-4bed-4fa0-934e-6e351ce2b2ca tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 944 time: 0.0472436 Nov 11 14:37:25.655870 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f69b4bb4-1364-4eef-ad02-ba8162da7fc0 req-d9e7084c-75b1-46dc-ab1d-6ef3c7e13bd9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403922 Nov 11 14:37:26.588428 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:37:26.749804 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:37:26.753800 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:37:26.754217 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:26.769255 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d712ac6c-c325-4eca-8962-682ebc3aee36 req-73f3b81e-3c57-4737-923c-8c89a8d9dec5 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:26.770666 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d712ac6c-c325-4eca-8962-682ebc3aee36 req-73f3b81e-3c57-4737-923c-8c89a8d9dec5 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 944 time: 0.0488486 Nov 11 14:37:26.824468 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d712ac6c-c325-4eca-8962-682ebc3aee36 req-a4b32a01-1fb6-40f4-8516-3308af714666 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476167 Nov 11 14:37:26.847943 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:26.869594 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:26.872495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3692710-531a-4bcd-bf6a-dc4665f7e1cf" -d '{"events": [{"server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "name": "network-vif-plugged", "status": "completed", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:26.884768 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:26.911694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c27ff2b-219c-45ea-b09c-2a8c4cef60e1 x-openstack-request-id: req-6c27ff2b-219c-45ea-b09c-2a8c4cef60e1 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:26.911694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "name": "network-vif-plugged", "status": "completed", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:26.911694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-6c27ff2b-219c-45ea-b09c-2a8c4cef60e1 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:26.911694 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6', 'code': 200} Nov 11 14:37:26.952310 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:27.000198 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:27.182618 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01989e38-e705-4c32-baf0-3cc074aaab51 req-1730b4f5-7b56-4667-a5e6-69a9c5d726bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:27.184096 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-01989e38-e705-4c32-baf0-3cc074aaab51 req-1730b4f5-7b56-4667-a5e6-69a9c5d726bc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 1098 time: 0.0411143 Nov 11 14:37:27.227231 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-01989e38-e705-4c32-baf0-3cc074aaab51 req-d2835cc5-7126-46bc-a32f-c607b41874ff service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360827 Nov 11 14:37:27.936585 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c278ee5b-fd34-4495-9c21-c7fb5eeb2b89 req-43c910bd-fa52-48c8-800b-cbe65706fe05 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:27.938054 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c278ee5b-fd34-4495-9c21-c7fb5eeb2b89 req-43c910bd-fa52-48c8-800b-cbe65706fe05 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 945 time: 0.0484064 Nov 11 14:37:27.983595 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-c278ee5b-fd34-4495-9c21-c7fb5eeb2b89 req-bb8c8155-7b76-46a0-9c0d-18a2154ef799 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397577 Nov 11 14:37:29.096549 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0d8de7-4279-4828-b1f6-619b08f50802 req-d08a1467-0e41-44d1-ae96-539763b24cd9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:29.097959 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb0d8de7-4279-4828-b1f6-619b08f50802 req-d08a1467-0e41-44d1-ae96-539763b24cd9 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 945 time: 0.0476518 Nov 11 14:37:29.149309 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-bb0d8de7-4279-4828-b1f6-619b08f50802 req-f8bd7db0-a9dd-4ab4-8ffe-22292577e8b8 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455625 Nov 11 14:37:30.275542 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ff4a80-0729-48c2-970e-dab88a76a9a5 req-f83f5085-3a74-49c0-97c3-c8b685bd5fed tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:30.276982 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-38ff4a80-0729-48c2-970e-dab88a76a9a5 req-f83f5085-3a74-49c0-97c3-c8b685bd5fed tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 945 time: 0.0483963 Nov 11 14:37:30.323091 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-38ff4a80-0729-48c2-970e-dab88a76a9a5 req-5bff10a9-d5ac-49f1-8b7d-43f8cd20024f tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398803 Nov 11 14:37:31.441544 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e8c08d-b5cd-46a0-a126-e98103c4fd9f req-c89fca03-9a82-4f5c-9211-91659abf0965 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:31.443080 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46e8c08d-b5cd-46a0-a126-e98103c4fd9f req-c89fca03-9a82-4f5c-9211-91659abf0965 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 945 time: 0.0519214 Nov 11 14:37:31.490238 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46e8c08d-b5cd-46a0-a126-e98103c4fd9f req-1813233b-9277-479b-91ee-8c41513264e6 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407681 Nov 11 14:37:31.536796 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-05effd73-cded-4f89-b40d-7cf67e9233cb tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:31.538230 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-05effd73-cded-4f89-b40d-7cf67e9233cb tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 945 time: 0.0471516 Nov 11 14:37:31.624641 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Deleting port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:37:31.624975 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:31.713621 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] For port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:31.713897 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:31.726597 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Calling delete_port for a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:37:31.909929 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:31.922129 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['a0d6d2b8-496f-40e2-96ac-7e50a2818cd6'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:37:31.938463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Pushing event deleted for resources: {'Port': ['ID=a0d6d2b8-496f-40e2-96ac-7e50a2818cd6,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:31.950372 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.950780 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.951124 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.951493 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.951832 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.952161 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.952488 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.952814 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.953140 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.953468 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.953790 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.954110 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:31.986816 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] No DVR routers for this DVR port a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:37:31.989122 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:31.992515 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-46b551f2-e368-4c68-9d60-395ad1d46973 req-ea960171-22e6-446c-afeb-a7f9f77f4301 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "DELETE /v2.0/ports/a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 HTTP/1.1" status: 204 len: 173 time: 0.4481492 Nov 11 14:37:31.992952 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'name': 'network-vif-deleted', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:31.995200 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-145704fd-5b84-4f46-91fe-4a35f492c3db" -d '{"events": [{"server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "name": "network-vif-deleted", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:32.031747 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4dc42caa-beb1-409a-8d82-0159c099e34a x-openstack-request-id: req-4dc42caa-beb1-409a-8d82-0159c099e34a {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:32.032052 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "304fe71b-2866-42f8-b99a-f3f8d3656614", "name": "network-vif-deleted", "tag": "a0d6d2b8-496f-40e2-96ac-7e50a2818cd6", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:32.032287 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-4dc42caa-beb1-409a-8d82-0159c099e34a {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:32.032686 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '304fe71b-2866-42f8-b99a-f3f8d3656614', 'name': 'network-vif-deleted', 'tag': 'a0d6d2b8-496f-40e2-96ac-7e50a2818cd6', 'status': 'completed', 'code': 200} Nov 11 14:37:32.599807 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8de40ea6-a9b3-41ac-b1c9-16c4333597c1 req-ece28aae-57aa-48e8-a51f-a4419c4d227a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=304fe71b-2866-42f8-b99a-f3f8d3656614 HTTP/1.1" status: 200 len: 210 time: 0.0310066 Nov 11 14:37:33.852631 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0b5807be-3e88-4085-b9e0-e6758bb5373a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:33.854074 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0b5807be-3e88-4085-b9e0-e6758bb5373a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/networks?id=b4612dd8-1b77-44d3-96dc-147541870170 HTTP/1.1" status: 200 len: 808 time: 0.1009853 Nov 11 14:37:33.868176 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-c7f7398b-70df-4b99-8175-519f3d4a443b tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/quotas/869a2ebce51e4a1b8e021e489e00702d HTTP/1.1" status: 200 len: 375 time: 0.0085876 Nov 11 14:37:33.899356 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-d983737f-e618-438d-8e54-3f80e628f0c8 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0257146 Nov 11 14:37:33.992596 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-962507ea-ccc4-42e6-9a9d-20cddff5f155 service neutron] 10.222.0.10 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860167 Nov 11 14:37:34.080386 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-6f672fd7-0a54-4166-ab58-2ac5a4c6d220 service neutron] 10.222.0.10 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812340 Nov 11 14:37:34.333743 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e14fbcc9-f780-4a26-b979-1f27b16ed705 req-d32dc361-d16a-4e00-821b-7a82a5b89438 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 210 time: 0.0260108 Nov 11 14:37:34.653355 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:37:34.673927 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:37:34.674401 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device a0d6d2b8-496f-40e2-96ac-7e50a2818cd6 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:37:35.432465 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9694f739-f0df-45c5-a2c2-b2f336c6f7b3 req-97d5910b-1f5a-460d-9b47-f36859da5eb6 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 210 time: 0.0319948 Nov 11 14:37:36.024022 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-a07733cd-b27b-4bcf-8628-c399765e2d5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:36.192433 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-b701e259-2297-4342-9d01-5de4473328cf tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:36.193876 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-b701e259-2297-4342-9d01-5de4473328cf tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "GET /v2.0/networks?id=b4612dd8-1b77-44d3-96dc-147541870170 HTTP/1.1" status: 200 len: 808 time: 0.1005855 Nov 11 14:37:36.207505 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Request body: {'port': {'device_id': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170', 'admin_state_up': True, 'tenant_id': '869a2ebce51e4a1b8e021e489e00702d'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:36.339829 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:37:36.395238 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Made reservation on behalf of 869a2ebce51e4a1b8e021e489e00702d for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:37:36.398758 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:36.524293 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Allocated IP 172.20.0.10 (b4612dd8-1b77-44d3-96dc-147541870170/37f81eb6-175a-491e-8ad1-43747142ec69/05e6dfbf-c1d9-40f0-a893-e6312355649d) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:37:36.526000 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-48350b4c-8af0-4872-a2f5-99f3c3d4de98 req-168b3a18-2b71-42ce-93d8-02c7cf61c2cf tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 210 time: 0.0262392 Nov 11 14:37:36.669555 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:36.746744 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:36.788492 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Network b4612dd8-1b77-44d3-96dc-147541870170 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:37:36.793508 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:37:36.797175 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:37:36.823723 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Pushing event updated for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:36.851636 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:36.852243 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:36.929928 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0f6b99c2-681b-4030-a06f-0abce64bd05a tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7259154 Nov 11 14:37:36.942107 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Request body: {'port': {'device_id': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:37:36.993424 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.246899 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 05e6dfbf-c1d9-40f0-a893-e6312355649d {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:37:37.255385 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.267140 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Transition to ACTIVE for port object 05e6dfbf-c1d9-40f0-a893-e6312355649d will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:37:37.340354 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.388689 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Pushing event updated for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:37.453672 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Attempting to bind port 05e6dfbf-c1d9-40f0-a893-e6312355649d on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:37:37.454000 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Attempting to bind port 05e6dfbf-c1d9-40f0-a893-e6312355649d by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:37:37.454327 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Attempting to bind port 05e6dfbf-c1d9-40f0-a893-e6312355649d on network b4612dd8-1b77-44d3-96dc-147541870170 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:37:37.458486 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Port 05e6dfbf-c1d9-40f0-a893-e6312355649d on network b4612dd8-1b77-44d3-96dc-147541870170 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:37:37.458799 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Attempting to bind port 05e6dfbf-c1d9-40f0-a893-e6312355649d on network b4612dd8-1b77-44d3-96dc-147541870170 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:37:37.463622 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:37:37.463955 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Checking segment: {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:37:37.464326 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Bound using segment: {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:37:37.464737 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Bound port: 05e6dfbf-c1d9-40f0-a893-e6312355649d, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c1937a-5ea1-45cd-a17a-e589f410bf29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 309, 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:37:37.465079 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.527723 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:37:37.530558 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:37:37.581154 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.640676 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:37.641285 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:37.642638 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] 10.222.0.11 "PUT /v2.0/ports/05e6dfbf-c1d9-40f0-a893-e6312355649d HTTP/1.1" status: 200 len: 1094 time: 0.7045569 Nov 11 14:37:37.647138 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:37.649382 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9" -d '{"events": [{"name": "network-changed", "server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:37.673026 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040e9f3c-cfd9-4266-a618-0139e6547360 service neutron] Pushing event updated for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:37.688249 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0098510-2159-4772-8d0c-77a661dfcf39 req-4b8e9c88-19b0-4b94-8612-b9ea05f64153 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:37.689801 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d0098510-2159-4772-8d0c-77a661dfcf39 req-4b8e9c88-19b0-4b94-8612-b9ea05f64153 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 944 time: 0.0839479 Nov 11 14:37:37.691215 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b528776-6be6-4eb0-82a4-bc49d8d8009c x-openstack-request-id: req-9b528776-6be6-4eb0-82a4-bc49d8d8009c {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:37.691515 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:37.691768 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-9b528776-6be6-4eb0-82a4-bc49d8d8009c {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:37.692148 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d', 'status': 'completed', 'code': 200} Nov 11 14:37:37.768352 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d0098510-2159-4772-8d0c-77a661dfcf39 req-786fcc60-ac03-4d1c-b27d-1923e3a25bbd tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713630 Nov 11 14:37:37.774474 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-325e1523-d439-4ded-a4ed-3afeb31d55be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:37.775943 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-325e1523-d439-4ded-a4ed-3afeb31d55be service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 1097 time: 0.0654433 Nov 11 14:37:37.871024 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-d00e19c2-033a-453b-a8be-5bf28d810800 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:37.872500 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-d00e19c2-033a-453b-a8be-5bf28d810800 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=869a2ebce51e4a1b8e021e489e00702d&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0888770 Nov 11 14:37:37.967078 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-359633f0-d763-4208-85a6-c77acb9e0c52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:37.969063 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-165e56ae-4c4a-4d25-b5b4-07d3aecfd3a9 req-359633f0-d763-4208-85a6-c77acb9e0c52 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0894341 Nov 11 14:37:38.043434 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-724e46bc-c5f1-4069-89ca-823af1d8c982 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:38.044802 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-724e46bc-c5f1-4069-89ca-823af1d8c982 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=869a2ebce51e4a1b8e021e489e00702d&device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 1097 time: 0.0398846 Nov 11 14:37:38.086354 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-0e0d4a22-c2f2-453e-98d0-b87e5f826b89 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d HTTP/1.1" status: 200 len: 217 time: 0.0329089 Nov 11 14:37:38.137512 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e896e0-d37f-4110-be41-a7be501f3dce req-ad95e0a7-5ce0-43a6-9620-48bf3c582a0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:38.138959 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-ad95e0a7-5ce0-43a6-9620-48bf3c582a0d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=37f81eb6-175a-491e-8ad1-43747142ec69 HTTP/1.1" status: 200 len: 848 time: 0.0459278 Nov 11 14:37:38.169110 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-2403bf2d-51c7-49a3-aed2-20ef71423af3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=b4612dd8-1b77-44d3-96dc-147541870170&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232890 Nov 11 14:37:38.255775 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-f9178125-ab35-4413-b6c5-1f7bdff949c5 service neutron] 10.222.0.11 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793729 Nov 11 14:37:38.346820 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-70e896e0-d37f-4110-be41-a7be501f3dce req-ea80532f-120f-4f44-92cf-686cdb550037 service neutron] 10.222.0.11 "GET /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844522 Nov 11 14:37:38.458165 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-cfce4273-306b-4040-8d60-8df230683eb7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:38.890662 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a953a753-1a37-49d2-bfe1-cfb0109aaa01 req-13614afe-7352-4bec-96a1-b60939033e42 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:38.892121 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a953a753-1a37-49d2-bfe1-cfb0109aaa01 req-13614afe-7352-4bec-96a1-b60939033e42 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 944 time: 0.0563004 Nov 11 14:37:38.938992 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-a953a753-1a37-49d2-bfe1-cfb0109aaa01 req-e8ec9bef-de7d-458c-8c18-7c75f530fdef tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409141 Nov 11 14:37:39.677442 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:40.050491 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc38eb8-c66c-4abc-89c2-3e449e1fee04 req-8c9ed855-5a62-4403-8402-1d6d6d9cf667 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:40.051973 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8fc38eb8-c66c-4abc-89c2-3e449e1fee04 req-8c9ed855-5a62-4403-8402-1d6d6d9cf667 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 944 time: 0.0484917 Nov 11 14:37:40.098080 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-8fc38eb8-c66c-4abc-89c2-3e449e1fee04 req-bb5ec8b0-eeb8-4458-9aad-fd0b9150a92c tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403841 Nov 11 14:37:40.674574 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 05e6dfbf-c1d9-40f0-a893-e6312355649d details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:37:40.777798 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:40.788590 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': '05e6dfbf-c1d9-40f0-a893-e6312355649d', 'network_id': 'b4612dd8-1b77-44d3-96dc-147541870170', 'port_id': '05e6dfbf-c1d9-40f0-a893-e6312355649d', 'mac_address': 'fa:16:3e:2b:ca:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 309, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37f81eb6-175a-491e-8ad1-43747142ec69', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:37:40.814917 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:40.825740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:40.838692 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 05e6dfbf-c1d9-40f0-a893-e6312355649d {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:37:40.857744 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:40.906062 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:40.954708 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:40.961467 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.961805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.962135 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.962461 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.962788 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.963105 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.963447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.963765 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.964082 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.964396 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.964707 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:40.965016 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:37:41.101045 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['05e6dfbf-c1d9-40f0-a893-e6312355649d'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:37:41.214693 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e28efbe-9dfa-43ec-8c57-fc50050a78cb req-c6584848-f7db-48d7-ab6f-a2dcd42699fe tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:41.216292 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7e28efbe-9dfa-43ec-8c57-fc50050a78cb req-c6584848-f7db-48d7-ab6f-a2dcd42699fe tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 945 time: 0.0479274 Nov 11 14:37:41.264009 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-7e28efbe-9dfa-43ec-8c57-fc50050a78cb req-709ba264-5912-4266-a77c-e5a4bde4b086 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403452 Nov 11 14:37:41.715221 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:42.201020 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:42.381725 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa0414c-bce7-4bba-a955-d97a8853aecf req-dbe17e7f-0542-417a-9d02-9e6f2168a9e1 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:42.383091 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9aa0414c-bce7-4bba-a955-d97a8853aecf req-dbe17e7f-0542-417a-9d02-9e6f2168a9e1 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 945 time: 0.0518146 Nov 11 14:37:42.430457 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-9aa0414c-bce7-4bba-a955-d97a8853aecf req-135c4be3-6d78-4c61-a498-19d5bbafff49 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412140 Nov 11 14:37:42.690495 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 05e6dfbf-c1d9-40f0-a893-e6312355649d up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:37:42.797411 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port 05e6dfbf-c1d9-40f0-a893-e6312355649d completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:37:42.801013 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port 05e6dfbf-c1d9-40f0-a893-e6312355649d triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:37:42.801380 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:42.874695 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:42.896836 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:42.899035 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a67c6f6-e2a3-4bc5-a46d-ae9f800637c1" -d '{"events": [{"server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "name": "network-vif-plugged", "status": "completed", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:42.914600 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:42.935305 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d911d24-4583-49db-88ba-0ddd0be95591 x-openstack-request-id: req-0d911d24-4583-49db-88ba-0ddd0be95591 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:42.935624 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "name": "network-vif-plugged", "status": "completed", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:42.935877 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-0d911d24-4583-49db-88ba-0ddd0be95591 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:42.936272 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d', 'code': 200} Nov 11 14:37:42.997781 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:43.044118 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:43.248608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddbfb12-fa0f-4e83-b915-483cf919d0a1 req-283cdd60-b508-4f1e-84b6-1bb598492338 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:43.250614 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dddbfb12-fa0f-4e83-b915-483cf919d0a1 req-283cdd60-b508-4f1e-84b6-1bb598492338 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 1099 time: 0.0392261 Nov 11 14:37:43.295499 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dddbfb12-fa0f-4e83-b915-483cf919d0a1 req-8b5ae1dd-9912-458b-884a-cd2d7fcd3fbf service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355902 Nov 11 14:37:43.542190 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd563e5b-0455-471d-8171-34ae3171651e req-fab6fe60-bf8b-49cf-9ee7-2c3432f4092b tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:43.543692 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd563e5b-0455-471d-8171-34ae3171651e req-fab6fe60-bf8b-49cf-9ee7-2c3432f4092b tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 946 time: 0.0478556 Nov 11 14:37:43.591885 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-dd563e5b-0455-471d-8171-34ae3171651e req-c5b30974-ee40-4ef4-b364-d5afb7f07e77 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425320 Nov 11 14:37:44.707461 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2cf5d7-5ce4-4c76-b500-eddefa1e6e73 req-024d94c4-c147-4f64-b3c7-123188886726 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:44.708896 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dc2cf5d7-5ce4-4c76-b500-eddefa1e6e73 req-024d94c4-c147-4f64-b3c7-123188886726 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 946 time: 0.0489047 Nov 11 14:37:44.765152 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-dc2cf5d7-5ce4-4c76-b500-eddefa1e6e73 req-f292b09d-afc3-49af-8ddb-1f05508cbde1 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505037 Nov 11 14:37:45.899737 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e053cec2-633d-4d37-a7d9-1bf9df8f3f92 req-0d63a405-ab8e-4f94-b6c6-28f1197569f6 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:45.901314 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e053cec2-633d-4d37-a7d9-1bf9df8f3f92 req-0d63a405-ab8e-4f94-b6c6-28f1197569f6 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 946 time: 0.0483205 Nov 11 14:37:45.947392 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-e053cec2-633d-4d37-a7d9-1bf9df8f3f92 req-4ff7b8df-c774-4540-98e0-90fa34a91146 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403640 Nov 11 14:37:47.063627 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b325e4e2-6353-4f67-acce-7cd33b8856d1 req-7bfd99d2-ef1a-4ba2-9b5b-012250b20113 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:47.065070 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b325e4e2-6353-4f67-acce-7cd33b8856d1 req-7bfd99d2-ef1a-4ba2-9b5b-012250b20113 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 946 time: 0.0484233 Nov 11 14:37:47.111072 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b325e4e2-6353-4f67-acce-7cd33b8856d1 req-7d1af9f1-ef84-40c7-b12b-5e170d570ccc tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/security-groups?id=ae457fdc-11fe-40c5-aa0e-af2e29be9c80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401618 Nov 11 14:37:47.161352 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-083fa9d8-33b9-4205-ba47-81e890032185 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:37:47.162778 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-083fa9d8-33b9-4205-ba47-81e890032185 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 946 time: 0.0472038 Nov 11 14:37:47.250882 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Deleting port 05e6dfbf-c1d9-40f0-a893-e6312355649d {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:37:47.251138 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:47.336236 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] For port 05e6dfbf-c1d9-40f0-a893-e6312355649d, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=05e6dfbf-c1d9-40f0-a893-e6312355649d,segment=NetworkSegment(88c1937a-5ea1-45cd-a17a-e589f410bf29),segment_id=88c1937a-5ea1-45cd-a17a-e589f410bf29)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:37:47.336591 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:47.349069 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Calling delete_port for 05e6dfbf-c1d9-40f0-a893-e6312355649d owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:37:47.532601 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:47.543636 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['05e6dfbf-c1d9-40f0-a893-e6312355649d'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:37:47.558543 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Pushing event deleted for resources: {'Port': ['ID=05e6dfbf-c1d9-40f0-a893-e6312355649d,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:37:47.602858 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] No DVR routers for this DVR port 05e6dfbf-c1d9-40f0-a893-e6312355649d on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:37:47.605403 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:37:47.608787 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-b8d9780b-4ed0-4ffa-a97e-1bbbb285dd96 req-f7f564d6-814d-47e7-9984-6cbc596e7673 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.11 "DELETE /v2.0/ports/05e6dfbf-c1d9-40f0-a893-e6312355649d HTTP/1.1" status: 204 len: 173 time: 0.4399519 Nov 11 14:37:47.609220 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'name': 'network-vif-deleted', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:37:47.611602 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f47d5e0f-3536-4751-9d9f-bcba6029b277" -d '{"events": [{"server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "name": "network-vif-deleted", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:37:47.646725 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:37:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f6673c4-9860-41af-95e3-b7e7c0652fd7 x-openstack-request-id: req-5f6673c4-9860-41af-95e3-b7e7c0652fd7 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:37:47.647082 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc82efe9-eb12-49bf-96aa-607c0d266733", "name": "network-vif-deleted", "tag": "05e6dfbf-c1d9-40f0-a893-e6312355649d", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:37:47.647331 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-5f6673c4-9860-41af-95e3-b7e7c0652fd7 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:37:47.647899 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc82efe9-eb12-49bf-96aa-607c0d266733', 'name': 'network-vif-deleted', 'tag': '05e6dfbf-c1d9-40f0-a893-e6312355649d', 'status': 'completed', 'code': 200} Nov 11 14:37:48.221813 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-094adb60-b181-4d3d-a1c4-9472879cf854 req-0ee361ae-deea-4ffa-809a-13636e154075 tempest-VolumesActionsTest-556646075 tempest-VolumesActionsTest-556646075-project] 10.222.0.10 "GET /v2.0/ports?device_id=bc82efe9-eb12-49bf-96aa-607c0d266733 HTTP/1.1" status: 200 len: 210 time: 0.0259793 Nov 11 14:37:50.707425 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 05e6dfbf-c1d9-40f0-a893-e6312355649d no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:37:50.730570 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: 05e6dfbf-c1d9-40f0-a893-e6312355649d {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:37:50.730912 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device 05e6dfbf-c1d9-40f0-a893-e6312355649d not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:38:06.035461 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-9c464193-7150-4215-93d4-05bdb46995ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:08.466202 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-56a52019-a20e-4d55-be29-e55aad02c900 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:09.694226 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:10.780235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:11.726333 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:12.274911 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:13.340083 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:38:14.409724 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 40216) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:14.453766 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Deleting subnet 37f81eb6-175a-491e-8ad1-43747142ec69 {{(pid=102267) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 11 14:38:14.457369 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.495777 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-126208599'] for subnet, precommit_delete_associations {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.533334 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-605455'] for subnet, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.711545 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-605446', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3774788', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126445508', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-127257143'] for subnet, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.735996 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Pushing event deleted for resources: {'Subnet': ['ID=37f81eb6-175a-491e-8ad1-43747142ec69,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:38:14.741180 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for subnet, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.744572 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ac2db810-dbe7-47f5-bdc1-58137b6229ae admin admin] 10.222.0.10 "DELETE /v2.0/subnets/37f81eb6-175a-491e-8ad1-43747142ec69 HTTP/1.1" status: 204 len: 168 time: 0.3338556 Nov 11 14:38:14.747005 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 40218) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:14.813744 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3465827'] for network, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.894203 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-606134', 'neutron.services.segments.db._delete_segments_for_network-8764490884325'] for network, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.913462 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4612dd8-1b77-44d3-96dc-147541870170']}} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:38:14.922428 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88c1937a-5ea1-45cd-a17a-e589f410bf29') {'for_net_delete': True} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:38:14.922726 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.services.segments.db [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88c1937a-5ea1-45cd-a17a-e589f410bf29') {} {{(pid=102267) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 11 14:38:14.931770 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8764490888686', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-126208590'] for segment, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.944881 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774'] for segment, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.950533 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Releasing vlan 309 on physical network physnet1 to pool {{(pid=102267) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 11 14:38:14.950907 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3565774', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126445466'] for segment, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: Traceback (most recent call last): Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: timer() Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: cb(*args, **kw) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: return func(*args, **kwargs) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: self._notify() Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: self.callback(batched_events) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: event.method(event) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: aggregate_uuid = self.p_client.list_aggregates( Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: return f(self, *a, **k) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._get(url).json() Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: return self.request(url, 'GET', **kwargs) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: base_url = self.get_endpoint(auth, allow=allow, Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 11 14:38:14.952516 dv-cinder-777031-9-iscsi neutron-server[102267]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 11 14:38:15.066359 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-606081', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670625', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-393956'] for network, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.071648 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3696525'] for network, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.077519 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] 10.222.0.10 "DELETE /v2.0/networks/b4612dd8-1b77-44d3-96dc-147541870170 HTTP/1.1" status: 204 len: 168 time: 0.3267460 Nov 11 14:38:15.089389 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae82be93-aab9-4d7b-af40-354ed5fb81b0 admin admin] Pushing event deleted for resources: {'Network': ['ID=b4612dd8-1b77-44d3-96dc-147541870170,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:38:15.356828 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 40222) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:15.395962 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-c1592c5b-a1d2-4d3a-a757-c36986be9899 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=869a2ebce51e4a1b8e021e489e00702d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0380249 Nov 11 14:38:15.398220 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 40224) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:15.442881 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.463428 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.583616 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.586154 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:15.587282 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/ae457fdc-11fe-40c5-aa0e-af2e29be9c80 HTTP/1.1" status: 204 len: 168 time: 0.1882062 Nov 11 14:38:15.595676 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae457fdc-11fe-40c5-aa0e-af2e29be9c80,revision_number=None']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:38:15.602785 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.603121 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.603474 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.603801 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.604124 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.604448 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.604767 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.605083 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.605396 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.605709 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.606021 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:15.606332 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06f28dbd-cd4c-47dd-bbe3-91b987f88c00 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102268) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:36.036007 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-399fe078-a209-4b81-a24e-3d494b5e6a99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:38.474581 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-78f71e9c-a4b0-464e-b35d-b891f94b88b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:39.709562 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:40.785235 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:41.762885 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:42.243003 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:50.339551 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:38:56.177609 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [-] (102268) accepted ('10.222.0.10', 40478) {{(pid=102268) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:56.283469 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9527d9d2-0055-41c0-84ee-602222ca79e9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.358975 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9527d9d2-0055-41c0-84ee-602222ca79e9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.442532 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron_lib.callbacks.manager [None req-9527d9d2-0055-41c0-84ee-602222ca79e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102268) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.482544 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [None req-9527d9d2-0055-41c0-84ee-602222ca79e9 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=8fff7932ea0045bab005a79c990b7806&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3038726 Nov 11 14:38:56.483250 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9527d9d2-0055-41c0-84ee-602222ca79e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd888a62-0cd2-48ae-8f30-09d4d196c6cb,revision_number=1']} {{(pid=102268) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:38:56.486109 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 40482) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:38:56.535390 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.555307 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.711206 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.713886 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:38:56.715045 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/dd888a62-0cd2-48ae-8f30-09d4d196c6cb HTTP/1.1" status: 204 len: 168 time: 0.2277861 Nov 11 14:38:56.722670 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd888a62-0cd2-48ae-8f30-09d4d196c6cb,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:38:56.729723 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.730103 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.730440 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.730769 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.731101 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.731451 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.731784 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.736920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.736920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.736920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.736920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:56.736920 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f33d1d8-9577-40a9-afec-abbf31f66686 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102267) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:38:59.683709 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5e364ab8-dcde-4889-b193-4a69f0495d91 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=c83c706ab5b043dcadd380f1972a903a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0280433 Nov 11 14:38:59.863826 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5fd3f2b7-d3e2-4bff-a61e-cfa416a1b2ad tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:38:59.865371 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5fd3f2b7-d3e2-4bff-a61e-cfa416a1b2ad tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1765354 Nov 11 14:38:59.888367 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-a371fc21-f212-4511-bd6a-d4c78c7a94f0 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/quotas/c83c706ab5b043dcadd380f1972a903a HTTP/1.1" status: 200 len: 375 time: 0.0115507 Nov 11 14:38:59.918934 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-d2b9d04f-b11c-4603-acfb-6dea5de1d77b tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?tenant_id=c83c706ab5b043dcadd380f1972a903a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0253987 Nov 11 14:39:00.259750 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-8a3f7a99-7ebf-4efd-bc09-0a02d426af64 req-07416aba-b718-4790-b528-8d6ed5b2118c tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 210 time: 0.1277120 Nov 11 14:39:01.352385 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-28f85e60-cf6b-4f95-aa26-aaf6ee1f47e5 req-e7c4af53-8d64-42cd-a1cc-77232e351fc3 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 210 time: 0.0259125 Nov 11 14:39:01.996892 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-3e99cf0f-ac44-4d85-8199-2eba4c00e741 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=c83c706ab5b043dcadd380f1972a903a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0207732 Nov 11 14:39:02.103968 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-e2a8d571-d145-4035-b76a-d7901562a829 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:02.105721 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-e2a8d571-d145-4035-b76a-d7901562a829 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1025684 Nov 11 14:39:02.118368 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Request body: {'port': {'device_id': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3', 'admin_state_up': True, 'tenant_id': 'c83c706ab5b043dcadd380f1972a903a'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:39:02.308913 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Made reservation on behalf of c83c706ab5b043dcadd380f1972a903a for: {'port': 1} {{(pid=102267) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 11 14:39:02.312536 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.322157 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks [] for security_group, before_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.397608 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks [] for security_group, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.446150 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0080c5a7-7292-424f-999b-4d29883bcfef req-83639a17-a421-4e7c-819d-3053f5a091c7 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 210 time: 0.0256987 Nov 11 14:39:02.463502 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.520584 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Pushing event updated for resources: {'SecurityGroup': ['ID=70605b43-d397-4e0d-8dd7-b1b0f4d019f1,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:02.592463 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.db_base_plugin_common [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Allocated IP 192.168.233.251 (7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3/c8956072-efe3-4b30-a856-f2815b650289/ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6) {{(pid=102267) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 11 14:39:02.734415 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks [] for port, precommit_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.802630 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8764490549872', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_create {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.843600 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 is already hosted by enough agents. {{(pid=102267) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 11 14:39:02.848430 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.scheduler.base_scheduler [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Resources bound (agent type, host, resource id): {{(pid=102267) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 11 14:39:02.852538 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Received port after_create {{(pid=102267) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 11 14:39:02.875943 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Pushing event updated for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=1']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:02.905029 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:02.905657 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:02.982420 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-f771cd80-6e82-4366-b0e0-e93eaefabd04 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8677816 Nov 11 14:39:03.042032 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.v2.base [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Request body: {'port': {'device_id': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77703'}} {{(pid=102267) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 11 14:39:03.095269 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:03.113364 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-2849415b-324d-42e9-82fe-f11d24de57bc None None] Provisioning complete for port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 triggered by entity DHCP. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:39:03.113897 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-2849415b-324d-42e9-82fe-f11d24de57bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:03.146770 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-2849415b-324d-42e9-82fe-f11d24de57bc None None] Port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 cannot update to ACTIVE because it is not bound. {{(pid=102269) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 11 14:39:03.349745 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 {{(pid=102267) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:39:03.356712 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:03.367966 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.provisioning_blocks [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Transition to ACTIVE for port object ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 will not be triggered until provisioned by entity L2. {{(pid=102267) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 11 14:39:03.430404 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:03.485171 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Pushing event updated for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=2']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:03.591237 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Attempting to bind port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 on host hv-cinder-77703 for vnic_type normal with profile {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 11 14:39:03.591605 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Attempting to bind port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 by drivers openvswitch,hyperv on host hv-cinder-77703 at level 0 using segments [{'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 11 14:39:03.591936 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Attempting to bind port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 on network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:39:03.603927 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47d845a-3ddb-4468-b8c3-b0f099865f2f req-07aa448b-7701-47dc-b41b-926fa68e1694 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:03.605425 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f47d845a-3ddb-4468-b8c3-b0f099865f2f req-07aa448b-7701-47dc-b41b-926fa68e1694 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 948 time: 0.0834370 Nov 11 14:39:03.606451 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 on network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77703 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 11 14:39:03.606773 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Attempting to bind port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 on network 7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3 {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 11 14:39:03.614146 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Checking agent: {'id': '086ead64-2d84-45e7-88c5-52d9f5f3ffee', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77703', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'started_at': datetime.datetime(2021, 11, 11, 14, 21, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 11, 14, 38, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 11 14:39:03.614476 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Checking segment: {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102267) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 11 14:39:03.614995 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Bound using segment: {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'} {{(pid=102267) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 11 14:39:03.615446 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.managers [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Bound port: ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host: hv-cinder-77703, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 302, 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3'}}] {{(pid=102267) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 11 14:39:03.615800 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:03.941257 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-f47d845a-3ddb-4468-b8c3-b0f099865f2f req-c0aac571-7a76-4c5e-9823-8f15ee3b8ff9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3288069 Nov 11 14:39:03.960708 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, cleared binding levels {{(pid=102267) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 11 14:39:03.960708 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102267) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 11 14:39:04.088104 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126445566'] for port, after_update {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:04.123804 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.124410 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:04.125854 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] 10.222.0.11 "PUT /v2.0/ports/ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 HTTP/1.1" status: 200 len: 1098 time: 1.1350238 Nov 11 14:39:04.126312 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:39:04.128654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d209f760-9aaa-4917-b35d-d6b60b23eb62" -d '{"events": [{"name": "network-changed", "server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:39:04.153411 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5719deb4-91f7-46d3-9f18-da7e07b6d8bf service neutron] Pushing event updated for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=3']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:04.167695 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 11 Nov 2021 14:39:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2e8139c-b0e4-4ee9-9327-214269b797bf x-openstack-request-id: req-a2e8139c-b0e4-4ee9-9327-214269b797bf {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:39:04.167979 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:39:04.168231 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-a2e8139c-b0e4-4ee9-9327-214269b797bf {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:39:04.168657 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6', 'status': 'completed', 'code': 200} Nov 11 14:39:04.247582 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d209f760-9aaa-4917-b35d-d6b60b23eb62 req-e667469b-c234-45c8-acf8-ac6af717bc76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.249131 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d209f760-9aaa-4917-b35d-d6b60b23eb62 req-e667469b-c234-45c8-acf8-ac6af717bc76 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c83c706ab5b043dcadd380f1972a903a&device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 1101 time: 0.0571599 Nov 11 14:39:04.282241 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d209f760-9aaa-4917-b35d-d6b60b23eb62 req-21741716-593c-4091-b487-456f11ff4e77 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=c83c706ab5b043dcadd380f1972a903a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0239732 Nov 11 14:39:04.379707 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d209f760-9aaa-4917-b35d-d6b60b23eb62 req-5d07c262-e642-4efa-90f2-b85ee9a22f1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.381154 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-d209f760-9aaa-4917-b35d-d6b60b23eb62 req-5d07c262-e642-4efa-90f2-b85ee9a22f1a service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0923865 Nov 11 14:39:04.455654 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5fbd1d31-b12f-4fe8-a73d-114c44c4ac34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.457012 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-5fbd1d31-b12f-4fe8-a73d-114c44c4ac34 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c83c706ab5b043dcadd380f1972a903a&device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 1101 time: 0.0396178 Nov 11 14:39:04.500505 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-a53ca9f0-6b1b-4e32-8c08-34acd3b40917 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.251&port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 HTTP/1.1" status: 200 len: 217 time: 0.0358670 Nov 11 14:39:04.548521 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-87f7501c-8fb5-41fc-a1eb-e7dd328a06ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.549901 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-87f7501c-8fb5-41fc-a1eb-e7dd328a06ab service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c8956072-efe3-4b30-a856-f2815b650289 HTTP/1.1" status: 200 len: 843 time: 0.0413649 Nov 11 14:39:04.596631 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-0b65ca04-b9be-4783-b8a8-1e83ee29ec05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:04.598172 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-0b65ca04-b9be-4783-b8a8-1e83ee29ec05 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0404053 Nov 11 14:39:04.689213 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-1976e447-fd0f-4518-9908-1aa7de380674 service neutron] 10.222.0.11 "GET /v2.0/networks/7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837879 Nov 11 14:39:04.775666 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-fa87dec2-791e-46fd-ac01-53afb4fc7e61 req-1ebb3f83-a431-435a-b500-57cfd9ac8137 service neutron] 10.222.0.11 "GET /v2.0/networks/7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795958 Nov 11 14:39:05.061352 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddb2ecb-22f3-4498-906d-313379e735bc req-64bc340f-180c-4218-bcd6-a4632796c7cc tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:05.062704 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cddb2ecb-22f3-4498-906d-313379e735bc req-64bc340f-180c-4218-bcd6-a4632796c7cc tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 948 time: 0.0511298 Nov 11 14:39:05.107573 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-cddb2ecb-22f3-4498-906d-313379e735bc req-6df3b211-9c44-472e-a988-1cdde0f2e9fb tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390294 Nov 11 14:39:06.019076 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-be3ba239-75dc-41c6-9e79-5ecebfcac8a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:06.229263 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ddfdcc-153a-4471-8937-fbfd246a6d8c req-8aacb191-af57-418f-adda-4b79390fa2a7 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:06.230625 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-23ddfdcc-153a-4471-8937-fbfd246a6d8c req-8aacb191-af57-418f-adda-4b79390fa2a7 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 948 time: 0.0553803 Nov 11 14:39:06.276763 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-23ddfdcc-153a-4471-8937-fbfd246a6d8c req-f8cdc89a-cfe0-4e05-849c-b790e7b2cc10 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403099 Nov 11 14:39:07.101844 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 details requested by agent hyperv_hv-cinder-77703 with host hv-cinder-77703 {{(pid=102269) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 11 14:39:07.192993 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:39:07.204047 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Returning: {'device': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6', 'network_id': '7d2a5f1e-ad4f-402e-bfd4-6dc64cac29a3', 'port_id': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6', 'mac_address': 'fa:16:3e:0b:53:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 302, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c8956072-efe3-4b30-a856-f2815b650289', 'ip_address': '192.168.233.251'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102269) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 11 14:39:07.243315 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:07.255384 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 {{(pid=102269) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 11 14:39:07.274703 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:39:07.368211 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:07.387555 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d00fee-34e5-4da9-b384-77610f8f053a req-4d0db2f2-08f8-4174-90e1-6e876528d2e1 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:07.390268 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-14d00fee-34e5-4da9-b384-77610f8f053a req-4d0db2f2-08f8-4174-90e1-6e876528d2e1 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 948 time: 0.0473740 Nov 11 14:39:07.415396 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=4']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:07.422170 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.422512 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.422847 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.423176 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.423536 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.423853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.424171 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.424487 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.424811 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.425136 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.425450 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.425763 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-777031-9-iscsi {{(pid=102269) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 11 14:39:07.437301 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-14d00fee-34e5-4da9-b384-77610f8f053a req-eb6de936-db57-493f-80e8-b65962e5918f tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422060 Nov 11 14:39:07.574111 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:39:08.465154 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-240d904a-dcee-485e-a8ae-a704849a99e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:08.551116 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1458c99-5e4f-4020-8b6c-e99a78bc2c5a req-3eff9066-3e93-49ef-b67a-fb2dcd9dda4b tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:08.552580 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f1458c99-5e4f-4020-8b6c-e99a78bc2c5a req-3eff9066-3e93-49ef-b67a-fb2dcd9dda4b tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 949 time: 0.0478079 Nov 11 14:39:08.599071 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f1458c99-5e4f-4020-8b6c-e99a78bc2c5a req-6659ad78-c607-4517-b4eb-64b1edf1aa52 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407586 Nov 11 14:39:09.110664 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 up at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 11 14:39:09.224584 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning for port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 completed by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 11 14:39:09.228394 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.db.provisioning_blocks [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Provisioning complete for port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 triggered by entity L2. {{(pid=102269) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 11 14:39:09.228790 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-591677'] for port, provisioning_complete {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:09.307787 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3584885'] for port, before_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:09.328848 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6'}] {{(pid=102269) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:39:09.331036 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b07a917f2fd278d31925ef41f2e1eae5d8177c65a9bc5f438901ff34f480ed3f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d89bd39f-b7dd-4114-82d9-91b0f9638371" -d '{"events": [{"server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "name": "network-vif-plugged", "status": "completed", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6"}]}' {{(pid=102269) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:39:09.342947 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102269) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:39:09.369993 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:39:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34394b32-8baf-43ac-91d1-5c18101eb9e0 x-openstack-request-id: req-34394b32-8baf-43ac-91d1-5c18101eb9e0 {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:39:09.370303 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "name": "network-vif-plugged", "status": "completed", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6", "code": 200}]} {{(pid=102269) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:39:09.370554 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-34394b32-8baf-43ac-91d1-5c18101eb9e0 {{(pid=102269) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:39:09.370944 dv-cinder-777031-9-iscsi neutron-server[102269]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6', 'code': 200} Nov 11 14:39:09.407645 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8764490977675', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8764490549890', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8764490549908'] for port, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:09.454381 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Pushing event updated for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=5']} {{(pid=102269) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:09.641901 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d2a71e-ae3d-4ccb-bbb6-a2d8061ecce8 req-d837e43b-d0f0-4ba4-9dae-9432edc39f0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:09.643449 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-98d2a71e-ae3d-4ccb-bbb6-a2d8061ecce8 req-d837e43b-d0f0-4ba4-9dae-9432edc39f0d service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 1103 time: 0.0459762 Nov 11 14:39:09.694406 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-98d2a71e-ae3d-4ccb-bbb6-a2d8061ecce8 req-e5f4da38-b2d1-43c4-95f7-1c32c7ca5741 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435450 Nov 11 14:39:09.703449 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:09.716254 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12115ed7-c622-4cad-bbc4-ba7e17f8b50b req-27cb6775-20a3-4b69-a526-5d373a0ce137 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:09.717692 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-12115ed7-c622-4cad-bbc4-ba7e17f8b50b req-27cb6775-20a3-4b69-a526-5d373a0ce137 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 950 time: 0.0493970 Nov 11 14:39:09.767529 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-12115ed7-c622-4cad-bbc4-ba7e17f8b50b req-7f69f3a9-88c5-460d-9c70-a412d9db8030 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438921 Nov 11 14:39:10.789361 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:10.884481 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1655307b-8d83-4e7e-9c2a-d50ce198603f req-ba278ebc-5222-4dfd-bf82-5607ee220839 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:10.885830 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1655307b-8d83-4e7e-9c2a-d50ce198603f req-ba278ebc-5222-4dfd-bf82-5607ee220839 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 950 time: 0.0467708 Nov 11 14:39:10.931252 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-1655307b-8d83-4e7e-9c2a-d50ce198603f req-034e154f-2782-462d-a393-0c4a55fd7e39 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395517 Nov 11 14:39:11.346382 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb98efc-a080-4712-a647-26fd88ad1eb0 req-2ce20ae4-17da-41f1-b20c-cd3dfb9365eb tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:11.347833 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-adb98efc-a080-4712-a647-26fd88ad1eb0 req-2ce20ae4-17da-41f1-b20c-cd3dfb9365eb tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 950 time: 0.0477381 Nov 11 14:39:11.394824 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-adb98efc-a080-4712-a647-26fd88ad1eb0 req-40fe7db0-f672-4e8b-957e-d8c5d2af1699 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405171 Nov 11 14:39:11.710568 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:12.224788 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:12.510600 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe30a73-c8a3-4de5-90aa-18591f02a08d req-19065eee-ab05-4c54-9a59-0bfd61290830 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102268) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:12.512071 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0fe30a73-c8a3-4de5-90aa-18591f02a08d req-19065eee-ab05-4c54-9a59-0bfd61290830 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 950 time: 0.0467186 Nov 11 14:39:12.557240 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-0fe30a73-c8a3-4de5-90aa-18591f02a08d req-01ec3576-0b58-4be0-af9f-86f3036b7376 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/security-groups?id=70605b43-d397-4e0d-8dd7-b1b0f4d019f1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393803 Nov 11 14:39:12.616880 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-3a4abc1a-2b7d-4eb5-98c7-9773e0ada961 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102267) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 11 14:39:12.618389 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-3a4abc1a-2b7d-4eb5-98c7-9773e0ada961 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.11 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 950 time: 0.0535922 Nov 11 14:39:12.708796 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Deleting port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 {{(pid=102267) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 11 14:39:12.709131 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8764490969775'] for port, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:12.799960 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.db [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] For port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6, host hv-cinder-77703, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77703',level=0,port_id=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,segment=NetworkSegment(e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6),segment_id=e6ee9aff-5a7a-4a99-8d34-725ba0edb4b6)] {{(pid=102267) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 11 14:39:12.800323 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-519188'] for port, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:12.813012 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.plugins.ml2.plugin [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Calling delete_port for ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 owned by compute:nova {{(pid=102267) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 11 14:39:13.008785 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3590862', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4073626', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3696539', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8764490977657', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8764490549881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126445545'] for port, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:13.020542 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.db [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] get_ports_and_sgs() called for port_ids ['ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6'] {{(pid=102269) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 11 14:39:13.040361 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Pushing event deleted for resources: {'Port': ['ID=ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:13.081857 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] No DVR routers for this DVR port ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 on host hv-cinder-77703 {{(pid=102267) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 11 14:39:13.084492 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-6808'] for port, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:13.088052 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [req-2f527bf3-fd71-42d9-ba55-4db99408acee req-be3ba092-9578-487b-8537-123a9acf70d9 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.11 "DELETE /v2.0/ports/ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 HTTP/1.1" status: 204 len: 173 time: 0.4625149 Nov 11 14:39:13.088501 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'name': 'network-vif-deleted', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6'}] {{(pid=102267) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 11 14:39:13.090793 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.10/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b524dc4fa056c49f3e12f2b0dbd6ff11574065ce15d9c008ec4a80cc468ea081" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-813b69a7-12c7-4d90-8bbe-735623bd9de0" -d '{"events": [{"server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "name": "network-vif-deleted", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6"}]}' {{(pid=102267) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 11 14:39:13.129033 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 11 Nov 2021 14:39:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49753df4-e829-4296-b52e-8ffe3cd6cf98 x-openstack-request-id: req-49753df4-e829-4296-b52e-8ffe3cd6cf98 {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 11 14:39:13.129529 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f5bdccf-a38f-488c-8f21-03e9593a78d7", "name": "network-vif-deleted", "tag": "ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6", "status": "completed", "code": 200}]} {{(pid=102267) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 11 14:39:13.129955 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.10/compute/v2.1/os-server-external-events used request id req-49753df4-e829-4296-b52e-8ffe3cd6cf98 {{(pid=102267) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 11 14:39:13.130455 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f5bdccf-a38f-488c-8f21-03e9593a78d7', 'name': 'network-vif-deleted', 'tag': 'ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6', 'status': 'completed', 'code': 200} Nov 11 14:39:13.661770 dv-cinder-777031-9-iscsi neutron-server[102268]: INFO neutron.wsgi [req-f7c3cfc6-a001-4965-bd2d-ee78bbcbe25a req-cce482a2-c1c8-4caa-92de-05a8c3601556 tempest-VolumesNegativeTest-1658984552 tempest-VolumesNegativeTest-1658984552-project] 10.222.0.10 "GET /v2.0/ports?device_id=1f5bdccf-a38f-488c-8f21-03e9593a78d7 HTTP/1.1" status: 200 len: 210 time: 0.0263312 Nov 11 14:39:15.129505 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 no longer exists at agent hyperv_hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 11 14:39:15.150030 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.plugin [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] No Port match for: ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 {{(pid=102269) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 11 14:39:15.150780 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron.plugins.ml2.rpc [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Device ba182309-6fde-4bf6-a9a8-1b7f43e2c9d6 not bound to the agent host hv-cinder-77703 {{(pid=102269) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 11 14:39:20.286210 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 40834) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:39:20.415184 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-90e910cc-34f2-4223-abd6-ede964653a76 admin admin] 10.222.0.10 "GET /v2.0/security-groups?tenant_id=c83c706ab5b043dcadd380f1972a903a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1278112 Nov 11 14:39:20.417666 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [-] (102267) accepted ('10.222.0.10', 40838) {{(pid=102267) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 11 14:39:20.462618 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:20.486662 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:20.585121 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3670577'] for security_group, after_delete {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:20.587766 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron_lib.callbacks.manager [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102267) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:20.588929 dv-cinder-777031-9-iscsi neutron-server[102267]: INFO neutron.wsgi [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] 10.222.0.10 "DELETE /v2.0/security-groups/70605b43-d397-4e0d-8dd7-b1b0f4d019f1 HTTP/1.1" status: 204 len: 168 time: 0.1703861 Nov 11 14:39:20.597781 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73a5982-a074-462d-9b62-7b20e6170903 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70605b43-d397-4e0d-8dd7-b1b0f4d019f1,revision_number=None']} {{(pid=102267) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 11 14:39:27.341864 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:39:36.047358 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d8c78677-1d13-4067-b3f2-5ba6489ce3c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:38.508877 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-359c121d-55ae-470b-87bd-4cb5041d90ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:39.704178 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:40.799804 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:41.710075 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:39:42.359837 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:04.341609 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:40:06.018330 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-fb74c6dc-ed02-43d4-9750-c79fb11c8edc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:08.486549 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-ad3e7813-8d73-44c9-bcae-6b5a2c728ac7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:09.692767 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:10.788528 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:11.697921 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:12.235412 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:36.016652 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-cbd77634-5094-445f-bc8a-2192e55e8db4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:38.458018 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0ad5504c-9365-42e8-b319-a8bed3cf35bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:39.709605 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:40.812029 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:41.340565 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:40:41.686566 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:40:42.286090 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:06.000414 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-1efd8c48-f616-4918-b80f-f6b699987c5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:08.491586 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-d245de8e-794b-4fd0-96c7-cf8a1029f8bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:09.708049 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:10.811447 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:11.720417 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:12.291928 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:18.339109 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:41:36.039828 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-0a7ffe15-2945-4dbb-a130-8479e6b8eeaa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:38.462746 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-9068ff3b-28a6-45dd-91b8-c35246d709d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:39.702547 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:40.805434 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:41.697364 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:42.268347 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:41:55.337676 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:42:06.022619 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-88bffb2c-a4e3-4ca9-a652-0a120da92be7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:08.473584 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-eb8f79a5-76c8-4379-af4f-ef9751b651b7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:09.725477 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:10.845962 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:11.702767 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:12.256926 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:32.336165 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:42:34.050382 dv-cinder-777031-9-iscsi neutron-server[102267]: DEBUG neutron.wsgi [req-36895af9-4a2f-459c-912e-b463ea7ce4fd req-21f32ee3-05d9-4e36-beca-dfa02157001c service neutron] (102267) timed out ('10.222.0.10', 35806) {{(pid=102267) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 11 14:42:36.033694 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-830f3417-3ae3-46e8-831b-322efcc336db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:38.485291 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-5b5565a9-1700-4d31-a06c-f2d39eac3997 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:39.713853 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:40.822680 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:41.719133 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:42.301637 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:42:50.040019 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-2a68b9ab-20d2-4559-836d-bd57c1f5889a req-d6348485-a327-4528-8ac0-781465cda579 service neutron] (102268) timed out ('10.222.0.11', 49923) {{(pid=102268) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 11 14:43:06.050854 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-b43f814d-2f44-4189-a487-066b6ff71aac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:08.519250 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-224b18c1-93ea-4f87-9b35-57efd2301ee5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:09.334877 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:43:09.753740 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:10.816014 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:11.701805 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:12.284231 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:36.021326 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-e0c78e2d-b51d-45df-9c48-6c99a9f051cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:38.484446 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-75a1b912-dad0-4f9c-9fd2-6dd06faa0136 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:39.690083 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:40.804125 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:41.695541 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:42.273072 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:43:46.332921 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:44:06.015645 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-3094f445-972d-41f9-ab90-9546908224ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:07.133966 dv-cinder-777031-9-iscsi neutron-server[102268]: DEBUG neutron.wsgi [req-21b68f7f-967d-4ec2-9490-6c3778696fe3 req-0f086450-852f-4c63-a258-e4d4d2486c6e tempest-TestMinimumBasicScenario-231669333 tempest-TestMinimumBasicScenario-231669333-project] (102268) timed out ('10.222.0.11', 49909) {{(pid=102268) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 11 14:44:08.507126 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-be7342ca-a087-4685-8c18-b4fb0a3ea0be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:09.689850 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:10.798488 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:11.735778 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:12.272515 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:23.331443 dv-cinder-777031-9-iscsi neutron-server[102270]: DEBUG neutron.db.agents_db [None req-39efff08-2058-4dfd-8f75-23be2971763f None None] Agent healthcheck: found 6 active agents {{(pid=102270) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 11 14:44:36.009888 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-abb62399-e01f-408b-afbe-98a5d1771d22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:38.461288 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-35f07671-eee0-4ad8-9ac4-64acfc08b4de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:39.707762 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-6eb8b825-152f-45ea-9b10-65e9d95ec13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:40.826860 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c8a18dce-f909-40be-9710-74508d4af356 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:41.712913 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-47ef1e81-02f7-4490-8412-c9aa1585d9eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 11 14:44:42.312682 dv-cinder-777031-9-iscsi neutron-server[102269]: DEBUG neutron_lib.callbacks.manager [None req-c33a13a9-89de-466a-b533-466a8e113371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8764490884307', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-591692'] for agent, after_update {{(pid=102269) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}